-- Logs begin at Wed 2022-07-20 07:42:07 UTC, end at Wed 2022-07-20 08:47:54 UTC. -- Jul 20 08:16:21.442893 dv-cinder-823089-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 08:16:21.450353 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 08:16:21.453737 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 08:16:21 2022] *** Jul 20 08:16:21.453737 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 08:16:21.453737 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 08:16:21.453737 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: nodename: dv-cinder-823089-3-iscsi Jul 20 08:16:21.453737 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: machine: x86_64 Jul 20 08:16:21.453737 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: clock source: unix Jul 20 08:16:21.453737 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: pcre jit disabled Jul 20 08:16:21.453737 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: detected number of CPU cores: 4 Jul 20 08:16:21.453737 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: current working directory: / Jul 20 08:16:21.453737 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: detected binary path: /usr/bin/uwsgi-core Jul 20 08:16:21.453737 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: your processes number limit is 47680 Jul 20 08:16:21.453737 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: your memory page size is 4096 bytes Jul 20 08:16:21.454503 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: detected max file descriptor number: 2048 Jul 20 08:16:21.454503 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: lock engine: pthread robust mutexes Jul 20 08:16:21.454503 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: thunder lock: enabled Jul 20 08:16:21.454503 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 08:16:21.454503 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 08:16:21.499029 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: Python main interpreter initialized at 0x561b26be79c0 Jul 20 08:16:21.499029 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: python threads support enabled Jul 20 08:16:21.499029 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: your server socket listen backlog is limited to 100 connections Jul 20 08:16:21.499029 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: your mercy for graceful operations on workers is 90 seconds Jul 20 08:16:21.499450 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 08:16:21.499450 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: *** Operational MODE: preforking *** Jul 20 08:16:21.500361 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: *** uWSGI is running in multiple interpreter mode *** Jul 20 08:16:21.500361 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: spawned uWSGI master process (pid: 103270) Jul 20 08:16:21.500575 dv-cinder-823089-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 08:16:21.501500 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: spawned uWSGI worker 1 (pid: 103271, cores: 1) Jul 20 08:16:21.501616 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: spawned uWSGI worker 2 (pid: 103272, cores: 1) Jul 20 08:16:21.501685 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 08:16:22.194362 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 08:16:22.217207 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 08:16:23.380629 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 08:16:23.380629 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: from cryptography.utils import int_from_bytes Jul 20 08:16:23.381270 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 08:16:23.381270 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: from cryptography.utils import int_from_bytes Jul 20 08:16:23.381673 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 08:16:23.381673 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: from cryptography.utils import int_from_bytes Jul 20 08:16:23.381851 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 08:16:23.381851 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: from cryptography.utils import int_from_bytes Jul 20 08:16:26.126916 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 08:16:26.127782 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 08:16:26.128141 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 08:16:26.128611 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 08:16:26.128971 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 08:16:26.129453 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.129880 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.130306 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.130784 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.131220 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.131642 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.132135 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.132586 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.133024 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.133389 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.133819 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.134347 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-823089-3-iscsi {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.134805 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.135199 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.135599 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.136029 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.136411 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.136806 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.137197 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.137881 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.138534 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.139030 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.139492 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.140030 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.140572 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.141027 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.141455 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.141949 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.142402 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.142901 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.143963 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-823089-3-iscsi {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.144465 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.144935 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.145403 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.146052 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.146450 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.146875 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.147275 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.147690 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.148070 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.148473 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.148878 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.149271 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.149658 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.150035 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.150409 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.150845 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.151235 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.151633 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.152024 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.152376 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.152765 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.153153 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.153548 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.153935 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.154263 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.154620 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.155026 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.155432 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.155812 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.156772 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.157144 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.157522 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.157896 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.158270 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.158687 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.159070 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.159461 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.159843 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.160238 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.160620 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.161016 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.161500 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.161827 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.162323 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.162713 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.163110 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.163493 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.163888 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.164278 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.164801 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.165117 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.165504 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.165902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.166309 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.166844 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.167197 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.167632 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.168070 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.168527 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.169022 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.169454 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.169890 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.170315 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.170787 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.171229 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.172300 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.172731 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.173166 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.173597 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.174032 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.174475 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.174973 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.175445 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.175880 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.176295 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.176711 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.177126 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.177539 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.177973 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.178385 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.178829 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.179258 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.179678 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.180091 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.180513 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.180918 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.181325 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.181748 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.182164 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.182598 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.183052 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.183477 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.183888 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.184310 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.184729 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.185182 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.185649 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.186059 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.186469 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.186920 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.187401 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.187827 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.188247 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.188665 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.189079 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.189514 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.189965 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.190403 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.190898 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.191322 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.191763 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.192207 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.192668 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.193087 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.193505 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.193945 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.194369 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.194828 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.195256 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.195784 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.196208 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.196647 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.197073 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.197572 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.197957 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.198372 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.198847 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.199280 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.199718 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.200141 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.200654 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.201072 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.201487 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.201913 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.202351 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.202849 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.203299 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.203715 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.204144 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.204655 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.205071 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.205506 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.206004 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.206424 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.206891 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.207322 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.207738 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.208180 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.208607 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.209033 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.209445 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.209930 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.210380 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.210900 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.211356 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.211825 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.212268 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.212721 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.213172 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.213622 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.214082 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.214550 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.215073 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.215541 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.216053 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.216454 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.216851 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.217235 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.217647 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.218056 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.219028 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.219412 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.219816 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.220197 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.220577 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.220975 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.221350 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.221727 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.222107 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.222507 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.222914 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.223306 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.223684 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.224085 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.224468 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.224851 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.225265 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.225668 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.226100 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.226528 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.226962 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.227348 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.227734 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.228205 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.228590 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.228963 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.229375 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.229753 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.230132 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.230511 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.230934 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.231309 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.231685 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.232082 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.232462 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.232874 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.233295 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.233707 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.234865 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.235327 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.235809 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.236405 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.236820 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.237217 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.237670 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.238079 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.238518 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.238926 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.239291 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.239664 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.240039 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.240410 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.240837 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.241206 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.241598 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.241958 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.242335 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.242731 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.243103 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.243504 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.243898 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.244616 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.245047 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.245462 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.245887 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.246381 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.246857 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.247292 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.247709 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.248190 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.248669 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.249099 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.249515 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.249995 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.250408 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.250946 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.251366 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.251792 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.252237 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.252678 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.253094 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.253513 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.253941 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.254352 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.254819 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.255377 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.255773 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.256184 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.256612 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.257064 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.257490 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.257912 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.258358 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.258835 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.259249 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.259656 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.260077 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.260492 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.260945 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.261403 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.261839 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.262265 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.262726 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.263138 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.263576 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.263989 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.264400 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.264859 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.265358 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.265846 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.266291 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.266772 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.267249 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.267713 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.268170 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.268623 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.269079 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.269536 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.270003 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.270476 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.270963 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.271419 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.271874 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.272325 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.272783 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.273242 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.273697 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.274153 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.274658 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.275203 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.275616 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.276082 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.276800 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.277262 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.277707 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.278163 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.278645 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.279160 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.279630 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.280090 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.280554 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.281551 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.282004 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.282453 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.282932 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.283378 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.283819 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.284256 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.284701 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.285144 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.285599 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.286038 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.286480 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.286946 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.287400 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.287838 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.288300 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.288778 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.289238 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.289687 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.290126 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.290633 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.291062 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.291543 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.291996 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.292471 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.292935 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.293438 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.293891 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.294329 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.294837 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.295296 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.295739 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.296190 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.297400 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.297788 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.298226 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.298714 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.299161 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.299617 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.300059 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.300502 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.300946 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.301389 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.301848 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.302297 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.302779 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.303218 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.303668 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.304120 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.304622 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.305067 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.305525 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.305972 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.306410 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.306885 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.307334 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.307830 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.308273 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.308710 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.309174 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.309628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.310076 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.310515 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.310992 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.311430 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.311867 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.312371 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.312835 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.313294 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.313732 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.314178 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.314685 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.315148 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.315600 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.316043 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.316481 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.316923 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.317361 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.317879 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.318316 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.318819 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.319264 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.319702 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.320137 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.320558 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.321016 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.321425 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.321892 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.322300 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.322768 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.323192 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.323606 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.324022 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.324449 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.324858 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.325288 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.325702 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.326124 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.326643 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.327045 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.327477 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.328009 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.328443 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.328819 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.329213 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.329616 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.330053 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.330423 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.330833 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.331204 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.331565 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.331931 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.332290 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.332658 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.333021 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.333382 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.333750 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.334106 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.334466 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.334864 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.335222 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.335611 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.335975 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.336389 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.336815 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.337225 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.337720 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.338193 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.338748 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.339119 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.339482 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.339836 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.340277 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.340637 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.341011 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.341377 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.341734 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.342208 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.342565 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.342964 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.343322 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.344219 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.344569 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.344927 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.345307 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.345659 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.346021 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.346465 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.346928 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.347347 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.347771 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.348371 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.348834 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.349250 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.349779 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.350210 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.350677 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.351085 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.351479 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.351881 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.352255 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.352651 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.353073 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.353473 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.353870 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.354251 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.354702 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.355082 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.355484 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.355873 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.356271 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.356727 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.357295 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.357746 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.358205 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.358721 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.359820 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.360265 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.360765 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.361218 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.361658 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.362109 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.362590 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.363034 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.363479 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.363925 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.364376 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.364829 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.365268 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.365723 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.366166 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.366657 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.367129 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.367595 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.368051 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.368494 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.369216 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.369673 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.370112 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.370566 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.371054 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.371534 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.371976 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.372445 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.372919 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.373383 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.373835 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.374305 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.374850 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.375305 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.375766 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.376237 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.376689 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.377136 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.377582 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.378019 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.378503 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.378979 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.379426 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.379863 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.380301 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.380739 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.381215 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.381664 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.382120 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.382573 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.383063 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.383514 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.383960 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.384436 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.384911 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.385475 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.385931 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.386397 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.386949 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.387395 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.387856 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.388315 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.388771 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.389267 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.389725 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.390178 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.390987 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.391451 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.391871 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.392304 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.392725 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.393152 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.393828 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.394257 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.394720 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.395140 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.395559 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.395978 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.396418 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.396989 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.397341 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.397758 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.398175 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.398642 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.399187 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.399622 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.400073 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.400500 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.400920 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.401342 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.401763 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.402229 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.402692 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.403390 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.403675 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.404098 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.404530 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.404994 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.405420 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.405846 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.407539 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.407771 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.408197 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.408635 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.409061 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.409499 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.409950 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.410376 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.411044 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.411444 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.411903 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.412579 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.413004 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.413446 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.413886 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.414316 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.414775 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.415208 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.415636 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.416057 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.416472 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.416894 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.417309 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.417786 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.418213 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.418668 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.419080 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.419509 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.419934 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.420616 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.421070 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.421710 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.422853 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.423612 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.423946 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.424362 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.424816 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.425276 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.425771 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.426202 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.426654 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.430417 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.430417 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.430417 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.430417 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.430417 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.430417 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.430417 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.431448 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.431572 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.432056 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.432485 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.433038 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.433594 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.434080 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.434519 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.435131 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.435491 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.436057 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.436666 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.437275 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.437822 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.438358 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.438833 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.439453 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.440029 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.440499 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.440969 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.441520 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.442022 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.442564 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.443134 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 08:16:26.443739 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.443882 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 08:16:26.444005 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.444304 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.444532 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 08:16:26.444766 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.445182 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 08:16:26.445623 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 08:16:26.445773 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.446218 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.446368 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.446603 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.446870 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.447000 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.447451 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.447579 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.447904 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.448031 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.448229 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.448551 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.448688 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.448893 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.449118 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.449244 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.449539 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.449682 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.449862 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.450188 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.450362 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.450515 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.450840 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.451013 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.451146 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.451317 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.451463 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.451758 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.451884 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.452080 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.452400 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.452563 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-823089-3-iscsi {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.452716 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.453570 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.453702 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.453894 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.454131 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.454313 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.454562 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.454815 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.454967 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.455215 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.455369 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.455534 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.455832 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.455987 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.456149 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.456408 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.456562 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.456753 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.456958 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.457136 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.457406 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.457723 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.457887 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.458085 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.458462 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.458628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.458803 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.459076 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.459234 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.459446 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.459616 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.459748 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.460083 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.460234 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.460405 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.460722 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.460875 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.461053 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.461342 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.461537 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.461744 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.461948 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.462153 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.462558 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.462815 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.462954 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.462954 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.463191 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.463324 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.463620 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.463781 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.463958 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.464302 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.464444 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-823089-3-iscsi {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.464632 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.464960 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.465088 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.465285 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.465502 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.465648 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.465932 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.466075 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.466316 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.466657 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.466788 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.466989 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.467289 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.467418 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.467646 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.467848 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.467973 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.468291 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.468824 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.469162 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.469297 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.469500 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.469500 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.469732 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.469864 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.470117 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.470810 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.471065 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.471367 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.471507 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.471677 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.471954 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.472085 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.472315 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.472527 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.472653 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.473046 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.473183 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.473374 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.473639 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.473769 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.474039 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.474215 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.474416 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.474775 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.474955 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.475086 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.475378 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.475529 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.476773 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.476901 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.477024 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.477024 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.477231 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.477403 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.477520 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.477654 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.477654 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.477907 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.478048 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.478048 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.478246 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.478400 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.478907 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.479075 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.479075 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.479305 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.479422 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.479555 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.479740 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.480074 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.480218 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.480394 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.480656 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.480810 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.481044 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.481211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.481355 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.481659 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.481834 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.481994 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.482273 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.482397 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.482618 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.482873 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.483153 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.483283 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.483398 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.483510 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.483837 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.484006 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.484278 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.484492 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.484611 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.484942 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.485107 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.485273 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.485568 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.485697 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.485898 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.486220 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.486359 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.486555 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.486841 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.487011 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.487276 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.487424 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.487591 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.487910 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.488066 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.488210 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.488448 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103271) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 08:16:26.488680 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.489146 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.489709 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.490280 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.490877 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.491455 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.492051 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.492603 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.493190 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.493760 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.494603 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.495203 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.495813 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.496376 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.496844 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.497413 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.497994 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.498638 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.499178 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.499763 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.500318 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.500881 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.501455 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.502022 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.502613 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.503193 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.503758 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.504274 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.504820 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.505358 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.505914 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.506498 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.507096 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.507639 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.508181 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.508767 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.509347 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.509947 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.510532 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.511140 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.511721 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.512296 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.512869 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.513444 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.514001 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.514562 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.515184 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.516358 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.516854 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.517435 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.518019 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.518617 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.519178 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.519758 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.520322 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.520883 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.521442 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.522020 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.522735 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.523186 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.523907 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.524390 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.524942 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.525558 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.526055 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:16:26.526710 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.527316 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.527922 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.528496 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.529082 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.529676 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.530263 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.530862 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.532039 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.532636 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.533201 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.533777 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.534350 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.534967 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.535543 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.536142 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.536702 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.537284 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.537862 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.538427 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.539046 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.539655 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.540240 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.540803 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.541411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.542028 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.542641 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.543211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.543803 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.544368 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.544936 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.545479 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.546089 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.546755 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.547319 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.547894 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.548469 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.549021 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.549571 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.550139 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.550733 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.551342 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.551904 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.552483 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.553032 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.553617 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.554184 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.554783 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.555346 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.555913 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.556465 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.557015 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.557588 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.558168 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.558765 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] Registered counter for database nova_api Jul 20 08:16:26.558915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.559414 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.559962 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.560545 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.561105 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.561662 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.562261 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.562845 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.563395 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.564112 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.564667 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.565224 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.565821 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.566391 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.566988 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.567570 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.568128 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.568682 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.569272 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.569839 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.570379 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.570964 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.571510 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.572082 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.572626 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.573197 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.573802 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.574412 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.575007 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.575576 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.576144 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.576691 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.577252 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.578321 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.578939 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.579482 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.580040 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.580587 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.581145 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.581689 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.582250 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.582845 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.583396 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.583975 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.584555 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.585093 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.585655 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.586264 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.586862 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.587427 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.588027 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.588578 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.589115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.589653 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.590190 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.590807 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.591349 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.591921 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.592475 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.593029 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.594178 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.594792 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.595655 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.596223 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.596811 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.597390 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.597967 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.598545 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.599135 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.599772 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.600368 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.600927 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.601508 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.602067 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.602664 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.603236 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.603791 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.604345 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.604928 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.605504 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.606077 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.606685 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.607270 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.607860 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.608436 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.609020 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.610130 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.610745 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.611350 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.611959 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.612501 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.613066 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.613641 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.614209 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.614807 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.615362 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.615929 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.616484 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.617034 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.617621 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.618177 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.618777 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.619596 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.620178 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.620759 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.621285 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.621851 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.622407 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.623043 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.623598 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.624195 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.625333 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.626437 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.626437 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.627070 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.627629 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.628200 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.628753 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.629312 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.629945 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.630523 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.631097 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.631700 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.632256 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.632823 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.633406 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.633985 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.634568 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.635198 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.635770 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.636340 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.637018 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.637512 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.638065 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.638645 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.639256 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.639827 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.640424 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.641006 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.641559 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.642142 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.642748 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.643778 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.644399 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.644953 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.645524 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.646106 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.646704 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.647301 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.647896 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.648503 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.649065 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.649627 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.650199 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.650797 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.651360 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.651921 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.652481 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.653054 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.653609 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.654157 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.654751 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.655312 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.655879 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.656498 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.657059 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.657621 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.658185 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.658819 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.659395 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.659943 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.660514 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.661056 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.661683 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.662246 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.662886 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.663460 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.664100 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.664659 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.665365 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.665937 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.666511 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.667093 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.667648 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.668215 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.668773 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.669338 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.669899 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.670463 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.671047 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.672149 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.672704 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.673268 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.673813 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.674430 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.674986 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.675544 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.676095 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.676653 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.677234 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.677766 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.678335 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.678930 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.679506 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.680069 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.681676 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.681676 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.682052 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.682388 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.682966 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.683558 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.684115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.684686 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.685225 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.685804 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.686339 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.686959 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.688083 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.688211 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 08:16:26.688664 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.689264 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.689841 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.690391 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.691002 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.691533 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.692085 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.692770 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.693213 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.693774 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.694318 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.694923 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.695469 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.696076 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.696647 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.696845 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 08:16:26.697186 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.697741 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.698286 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.698946 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.699495 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.700159 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.700695 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.701268 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.701843 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.702424 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.703068 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.703649 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.704228 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.704810 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.705377 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.705960 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.706534 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.707139 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.707754 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.708321 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.708876 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.709437 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.710032 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.710644 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.711208 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.711757 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.712317 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.712858 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.713427 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.713984 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.714556 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.715165 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.715727 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.716309 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.716865 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.717418 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.717990 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.718852 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.719275 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.719779 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.720372 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.720895 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.721402 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.721910 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.722445 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.723090 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.723794 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.724344 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.724916 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.725471 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.726046 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.726649 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.727242 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.727953 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.728390 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.729119 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.729667 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.730194 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.730532 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.730958 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.731284 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.731612 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.731953 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.732273 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.732589 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.732914 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.733249 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.733565 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.733898 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.734967 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.735295 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.735611 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.736039 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.736362 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.736680 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.737016 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.737352 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.737681 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.738103 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.738319 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.738662 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.738997 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.739328 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.739646 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.739968 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.740279 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.740613 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.740982 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.741305 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.741636 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.742071 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.742398 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.742745 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.743076 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.743409 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.743721 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.744325 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.744691 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.745048 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.745363 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.745693 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.746004 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.746320 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.746664 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.746982 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.747365 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.747717 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.748051 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.748376 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.748687 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.749034 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.749363 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.749779 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.750070 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.750401 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.750751 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.751061 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.751371 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.751680 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.752028 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.752338 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.752664 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.753046 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.753383 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.753697 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.754035 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.754364 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.755382 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.755720 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.756054 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.756366 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.756673 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.757021 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.757333 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.757754 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.758069 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.758553 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.758986 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.759445 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.759925 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.760513 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.761004 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.761474 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.762002 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.762502 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.763068 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.763552 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.764021 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.764342 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.764865 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.765066 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.765442 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.766053 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.766383 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.766744 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.767071 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.767393 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.767934 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.768104 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.768375 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.768779 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.769295 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.769733 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.770261 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.770729 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.771061 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.771985 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.772541 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.773096 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.773593 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.774157 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.774711 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.775262 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.775826 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.776341 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.776892 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.777430 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.777940 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.context [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a041b14b-60ad-4ca6-8308-c42feb8d914c(cell1) {{(pid=103271) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 08:16:26.778047 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.778512 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.779222 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.779669 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.780212 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.780753 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.781852 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.782356 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.782999 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.783204 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:16:26.783546 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.784080 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.784634 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.785115 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:16:26.785234 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.785639 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.786106 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:16:26.786217 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.786742 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.787189 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.787670 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.788091 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.788595 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.789082 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:16:26.789203 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.789561 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.790182 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.790833 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.791337 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.791697 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] Registered counter for database nova_cell0 Jul 20 08:16:26.791890 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.792249 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.792819 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.793629 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.794002 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.794837 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.795181 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.795663 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.796057 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.796700 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.797427 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] Registered counter for database nova_cell1 Jul 20 08:16:26.797780 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.798369 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.800348 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.800348 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.800348 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.801212 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.801212 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.801638 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.802117 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.802728 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.803202 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.804149 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.804715 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.805292 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.805846 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.806415 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.806961 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.807493 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.808062 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.808507 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.809001 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.809586 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.810106 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.810686 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.810941 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 08:16:26.811195 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.811691 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.812241 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.812428 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 08:16:26.812655 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.813212 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.813602 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.814725 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.814725 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.815250 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.815722 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.816271 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.816789 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.817113 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.817436 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.817785 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.818191 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.818510 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.818864 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.819180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.819511 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.819825 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.820218 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.820693 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.821136 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.821620 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.822061 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.822496 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.822913 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 08:16:26.823083 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.823373 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.823532 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 08:16:26.823813 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.824280 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.824754 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.825199 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.825993 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.826455 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.826965 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.827420 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.827892 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.828301 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.828809 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.829259 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.829693 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.830197 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.830735 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.831193 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.831640 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.832040 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.832475 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.832874 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.833246 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.833612 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.833975 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.834411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.834862 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.835277 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.835697 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.836220 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.836642 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.837061 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.837572 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.837992 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.838408 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.838933 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.839351 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.839763 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.840275 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.840793 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.841227 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.841633 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.842245 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.842768 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.843192 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.844139 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.844555 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.844991 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.845413 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.845838 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.846338 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.846796 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.847237 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.847677 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.848103 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.848537 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.849097 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.849460 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.849864 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.850281 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.850769 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.851202 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.851612 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.852042 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.852448 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.852891 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.853277 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.853658 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.854040 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.854425 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.854842 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.855222 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.855598 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.855985 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.856450 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.856913 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.857355 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.857791 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.858237 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.858717 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.859304 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.859675 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.860117 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.860650 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.861066 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.861596 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.862048 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.862533 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.863005 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.863441 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.863864 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.864806 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.865217 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.865652 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.866062 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.866541 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.867063 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.867476 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.867886 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.868297 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.868733 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.869418 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.869825 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.870256 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.870715 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.871141 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.871574 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.871992 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.872426 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.872856 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.873269 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.873681 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.874101 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.874521 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.875552 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.875967 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.876382 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.876905 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.877326 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.877765 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.878191 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.878615 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.879051 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.879490 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.879942 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.880361 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.880999 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.881336 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.881870 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.882280 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.882742 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:16:26.883082 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 08:16:26.960923 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO dbcounter [None req-c7197b3a-0379-475d-a1c3-9ebd5f234396 None None] Registered counter for database nova_api Jul 20 08:16:26.995862 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO dbcounter [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] Registered counter for database nova_cell0 Jul 20 08:16:27.005142 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_db.sqlalchemy.engines [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103271) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 08:16:27.012296 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writer thread running {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 08:16:27.100155 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG oslo_db.sqlalchemy.engines [None req-c7197b3a-0379-475d-a1c3-9ebd5f234396 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 08:16:27.107700 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writer thread running {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 08:16:27.173123 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.context [None req-c7197b3a-0379-475d-a1c3-9ebd5f234396 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a041b14b-60ad-4ca6-8308-c42feb8d914c(cell1) {{(pid=103272) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 08:16:27.179879 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-c7197b3a-0379-475d-a1c3-9ebd5f234396 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:16:27.182829 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-c7197b3a-0379-475d-a1c3-9ebd5f234396 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:16:27.184187 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-c7197b3a-0379-475d-a1c3-9ebd5f234396 None None] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:16:27.186809 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG oslo_concurrency.lockutils [None req-c7197b3a-0379-475d-a1c3-9ebd5f234396 None None] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:16:27.189421 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO dbcounter [None req-c7197b3a-0379-475d-a1c3-9ebd5f234396 None None] Registered counter for database nova_cell0 Jul 20 08:16:27.196226 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO dbcounter [None req-c7197b3a-0379-475d-a1c3-9ebd5f234396 None None] Registered counter for database nova_cell1 Jul 20 08:16:27.209661 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG oslo_db.sqlalchemy.engines [None req-c7197b3a-0379-475d-a1c3-9ebd5f234396 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 08:16:27.212537 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG oslo_db.sqlalchemy.engines [None req-c7197b3a-0379-475d-a1c3-9ebd5f234396 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 08:16:27.219306 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writer thread running {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 08:16:27.222224 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writer thread running {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 08:16:27.389126 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO dbcounter [None req-c7197b3a-0379-475d-a1c3-9ebd5f234396 None None] Registered counter for database nova_cell0 Jul 20 08:16:27.399325 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG oslo_db.sqlalchemy.engines [None req-c7197b3a-0379-475d-a1c3-9ebd5f234396 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 08:16:27.400607 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 08:16:27.409161 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 08:16:27.413218 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writer thread running {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 08:16:27.768646 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 08:16:27.775332 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: WARNING keystonemiddleware.auth_token [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 08:16:27.781345 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561b26be79c0 pid: 103271 (default app) Jul 20 08:16:27.784081 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:16:27.785325 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001943 Jul 20 08:16:27.785761 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Wed Jul 20 08:16:27 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:16:27.961210 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: WARNING keystonemiddleware.auth_token [None req-c7197b3a-0379-475d-a1c3-9ebd5f234396 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 08:16:27.977032 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: WARNING keystonemiddleware.auth_token [None req-c7197b3a-0379-475d-a1c3-9ebd5f234396 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 08:16:28.561519 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: WARNING keystonemiddleware.auth_token [None req-c7197b3a-0379-475d-a1c3-9ebd5f234396 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 08:16:28.569625 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: WARNING keystonemiddleware.auth_token [None req-c7197b3a-0379-475d-a1c3-9ebd5f234396 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 08:16:28.575756 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x561b26be79c0 pid: 103272 (default app) Jul 20 08:17:58.539609 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:17:58.541365 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002493 Jul 20 08:17:58.542041 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 930 bytes} [Wed Jul 20 08:17:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:17:58.564284 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=3 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:17:58.565726 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell0:SELECT=3 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:17:58.567367 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell1:SELECT=3 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:17:58.568663 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_cell0:SELECT=3 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:17:59.687089 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-d1d93ca9-05b4-4c4d-90fc-fbce40e9580d admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:17:59.765824 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-d1d93ca9-05b4-4c4d-90fc-fbce40e9580d admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.211802 Jul 20 08:17:59.766501 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1291 bytes} [Wed Jul 20 08:17:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:18:02.731882 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:02.732944 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-d67ce96b-a4d9-4043-903b-82f57488172b None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 20 08:18:02.733585 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 3/4] 10.222.0.64 () {54 vars in 930 bytes} [Wed Jul 20 08:18:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:18:03.304157 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-11361a1c-6f38-4ecb-a05d-7ad7a4539b79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "name": "cirros256", "id": "c1", "ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:03.322673 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 08:18:03.322673 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: warnings.warn(msg) Jul 20 08:18:03.355908 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-11361a1c-6f38-4ecb-a05d-7ad7a4539b79 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.614615 Jul 20 08:18:03.357363 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 2/5] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Jul 20 08:18:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:18:03.371917 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=3 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:18:03.372809 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell0:SELECT=3 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:18:03.373550 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell1:SELECT=3 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:18:03.374301 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:18:03.592195 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-3ea4f4e1-bff0-4770-bc7d-1ccb8100bf94 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:03.594729 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 08:18:03.594729 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: warnings.warn(msg) Jul 20 08:18:03.657014 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-3ea4f4e1-bff0-4770-bc7d-1ccb8100bf94 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.291168 Jul 20 08:18:03.657580 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 4/6] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Jul 20 08:18:03 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:18:06.032721 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-11361a1c-6f38-4ecb-a05d-7ad7a4539b79 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:06.033732 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-11361a1c-6f38-4ecb-a05d-7ad7a4539b79 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 20 08:18:06.034446 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 3/7] 10.222.0.64 () {54 vars in 930 bytes} [Wed Jul 20 08:18:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:18:06.882489 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-58d54ff1-d5a5-4379-983b-79c7d3c87e89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 5, "id": "d1"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:06.907036 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 08:18:06.907036 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: warnings.warn(msg) Jul 20 08:18:06.935698 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-58d54ff1-d5a5-4379-983b-79c7d3c87e89 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.892961 Jul 20 08:18:06.936939 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 5/8] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Jul 20 08:18:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:18:06.952530 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-3099d9ff-f95f-4345-8943-62f49379cf10 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:06.954204 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 08:18:06.954204 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: warnings.warn(msg) Jul 20 08:18:06.990208 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-3099d9ff-f95f-4345-8943-62f49379cf10 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042200 Jul 20 08:18:06.990838 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 4/9] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Jul 20 08:18:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:18:09.328350 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-58d54ff1-d5a5-4379-983b-79c7d3c87e89 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:09.329416 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-58d54ff1-d5a5-4379-983b-79c7d3c87e89 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jul 20 08:18:09.329823 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 930 bytes} [Wed Jul 20 08:18:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:18:09.776982 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-55deb4c6-2bf3-413d-90cc-4f51c0cfa527 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "vcpus": 1, "id": "d2", "swap": 0}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:09.798433 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-55deb4c6-2bf3-413d-90cc-4f51c0cfa527 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.462140 Jul 20 08:18:09.799163 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 5/11] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Jul 20 08:18:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:18:09.813074 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-1a615fa7-2c9d-48f7-ba40-e2b70b1b4791 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:09.839874 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-1a615fa7-2c9d-48f7-ba40-e2b70b1b4791 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031206 Jul 20 08:18:09.840704 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 7/12] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Jul 20 08:18:09 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:18:12.236354 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-55deb4c6-2bf3-413d-90cc-4f51c0cfa527 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:12.237389 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-55deb4c6-2bf3-413d-90cc-4f51c0cfa527 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 20 08:18:12.238282 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 6/13] 10.222.0.64 () {54 vars in 930 bytes} [Wed Jul 20 08:18:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:18:12.806162 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-51da5973-d10b-4f75-8d7f-f5856d42f1d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "swap": 0}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:12.825838 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-51da5973-d10b-4f75-8d7f-f5856d42f1d1 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.576933 Jul 20 08:18:12.826604 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 8/14] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Jul 20 08:18:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:18:12.839902 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-05debca6-3413-4368-900f-64417c44eda5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:12.864871 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-05debca6-3413-4368-900f-64417c44eda5 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029956 Jul 20 08:18:12.872988 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 7/15] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Jul 20 08:18:12 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:18:15.350388 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-51da5973-d10b-4f75-8d7f-f5856d42f1d1 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:15.352059 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-51da5973-d10b-4f75-8d7f-f5856d42f1d1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002355 Jul 20 08:18:15.352725 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 9/16] 10.222.0.64 () {54 vars in 930 bytes} [Wed Jul 20 08:18:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:18:15.864937 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-691d8feb-139b-423e-bc99-a3d01388e1f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:15.886553 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-691d8feb-139b-423e-bc99-a3d01388e1f6 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.522855 Jul 20 08:18:15.887276 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 8/17] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Jul 20 08:18:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:18:15.899761 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-ee6f57ae-894f-400b-a826-a4255a46c983 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:15.937877 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-ee6f57ae-894f-400b-a826-a4255a46c983 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041869 Jul 20 08:18:15.939299 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 10/18] 10.222.0.64 () {64 vars in 1335 bytes} [Wed Jul 20 08:18:15 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:18:18.416595 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-691d8feb-139b-423e-bc99-a3d01388e1f6 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:18.418529 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-691d8feb-139b-423e-bc99-a3d01388e1f6 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002862 Jul 20 08:18:18.419103 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 9/19] 10.222.0.64 () {54 vars in 930 bytes} [Wed Jul 20 08:18:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:18:18.949412 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-42da6e49-4b46-491c-8f13-005a687e6bde admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:18.973727 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-42da6e49-4b46-491c-8f13-005a687e6bde admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.546539 Jul 20 08:18:18.974280 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1291 bytes} [Wed Jul 20 08:18:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:18:21.889301 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-691d8feb-139b-423e-bc99-a3d01388e1f6 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:21.890306 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-691d8feb-139b-423e-bc99-a3d01388e1f6 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 20 08:18:21.890767 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 10/21] 10.222.0.64 () {54 vars in 930 bytes} [Wed Jul 20 08:18:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:18:22.356869 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-55bad08a-b8d1-48e7-ae8c-3de8319538dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.tiny", "ram": 512, "disk": 1, "rxtx_factor": 1.0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:22.376352 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-55bad08a-b8d1-48e7-ae8c-3de8319538dc admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.479087 Jul 20 08:18:22.376904 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 12/22] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Jul 20 08:18:21 2022] POST /compute/v2.1/flavors => generated 402 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:18:22.394178 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-f8aaccaa-33f5-4067-8502-e1afba834eb2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:22.421510 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-f8aaccaa-33f5-4067-8502-e1afba834eb2 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031210 Jul 20 08:18:22.422100 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 11/23] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Jul 20 08:18:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:18:24.764865 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-55bad08a-b8d1-48e7-ae8c-3de8319538dc admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:24.765795 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-55bad08a-b8d1-48e7-ae8c-3de8319538dc admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 20 08:18:24.766202 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 930 bytes} [Wed Jul 20 08:18:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:18:25.182048 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-3d18503f-2a2f-47e6-aece-201113db457a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 20, "id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:25.201067 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-3d18503f-2a2f-47e6-aece-201113db457a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.428563 Jul 20 08:18:25.201639 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 12/25] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Jul 20 08:18:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:18:25.213892 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-b803ede5-af1e-4e80-8699-6775da18c3c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:25.238506 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-b803ede5-af1e-4e80-8699-6775da18c3c7 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028404 Jul 20 08:18:25.240485 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 14/26] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Jul 20 08:18:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:18:27.661663 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-3d18503f-2a2f-47e6-aece-201113db457a admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:27.662785 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-3d18503f-2a2f-47e6-aece-201113db457a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001677 Jul 20 08:18:27.663411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 13/27] 10.222.0.64 () {54 vars in 930 bytes} [Wed Jul 20 08:18:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:18:28.222965 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-6f01999a-5655-42b4-bf93-1840b82ae220 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "disk": 40, "os-flavor-access:is_public": true, "id": "3", "swap": 0, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:28.254130 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-6f01999a-5655-42b4-bf93-1840b82ae220 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.583085 Jul 20 08:18:28.255564 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 15/28] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Jul 20 08:18:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:18:28.272360 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-42f5ef4b-cde2-4097-ac6c-5ea607347e21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:28.311364 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-42f5ef4b-cde2-4097-ac6c-5ea607347e21 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042453 Jul 20 08:18:28.312710 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Jul 20 08:18:28 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:18:30.702716 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-6f01999a-5655-42b4-bf93-1840b82ae220 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:30.703737 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-6f01999a-5655-42b4-bf93-1840b82ae220 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Jul 20 08:18:30.704440 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 16/30] 10.222.0.64 () {54 vars in 930 bytes} [Wed Jul 20 08:18:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:18:31.209949 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-6461d2d1-28f4-4294-89a5-f8963112d28e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192, "disk": 80, "id": "4"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:31.218076 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:18:31.234125 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-6461d2d1-28f4-4294-89a5-f8963112d28e admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.523199 Jul 20 08:18:31.235043 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 15/31] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Jul 20 08:18:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:18:31.250252 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-23187b82-5544-43da-8563-ff87b8f8af63 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:31.277809 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-23187b82-5544-43da-8563-ff87b8f8af63 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032207 Jul 20 08:18:31.278752 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 17/32] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Jul 20 08:18:31 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:18:33.641174 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-6461d2d1-28f4-4294-89a5-f8963112d28e admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:33.642250 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-6461d2d1-28f4-4294-89a5-f8963112d28e admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 20 08:18:33.642739 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 930 bytes} [Wed Jul 20 08:18:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:18:34.166566 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-97495b85-c35e-4e34-b077-cdadb109e89b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0, "disk": 160, "swap": 0}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:34.173984 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:18:34.186862 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-97495b85-c35e-4e34-b077-cdadb109e89b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.537930 Jul 20 08:18:34.194923 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 18/34] 10.222.0.64 () {64 vars in 1282 bytes} [Wed Jul 20 08:18:33 2022] POST /compute/v2.1/flavors => generated 408 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:18:34.200319 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-9d8278f2-a279-49bf-b46a-890d64252adf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:34.227516 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-9d8278f2-a279-49bf-b46a-890d64252adf admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031477 Jul 20 08:18:34.230041 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 17/35] 10.222.0.64 () {64 vars in 1332 bytes} [Wed Jul 20 08:18:34 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:18:52.596845 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-97495b85-c35e-4e34-b077-cdadb109e89b admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:52.597846 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-97495b85-c35e-4e34-b077-cdadb109e89b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 20 08:18:52.598258 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 930 bytes} [Wed Jul 20 08:18:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:18:52.609731 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:18:53.034688 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-84cf5398-215c-444d-b8a7-ba805c307362 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:53.052636 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-84cf5398-215c-444d-b8a7-ba805c307362 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.447266 Jul 20 08:18:53.053216 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1291 bytes} [Wed Jul 20 08:18:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:18:54.177975 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-97495b85-c35e-4e34-b077-cdadb109e89b admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:54.179008 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-97495b85-c35e-4e34-b077-cdadb109e89b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Jul 20 08:18:54.179593 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Jul 20 08:18:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:18:54.745355 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-ead02072-fbe0-4ed5-8de6-d73663fcb8f4 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:54.751110 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.wsgi [None req-ead02072-fbe0-4ed5-8de6-d73663fcb8f4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-ead02072-fbe0-4ed5-8de6-d73663fcb8f4 admin admin] Request method failure captured: Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Accept: application/json Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Accept-Encoding: gzip, deflate Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Connection: keep-alive Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Content-Length: 0 Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Host: 10.222.0.64 Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Openstack-Api-Version: compute 2.90 Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Openstack-System-Scope: None Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: User-Agent: python-novaclient Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Auth-Token: gAAAAABi17puxaftXU30O4uqgZ1jwc2IZPn9SfJAGVR14RLA8wDb2eMed8cYkRMMAfyNyuSx6E5qlJqP0y11JXDhMiAsF70xoJ2myYoHJSn8D7PBuLT0Finv7zos7ofAyp_lc_F5hIIF5tNVuCJMlF1HLReyE3-C2Ri4hx2qAMjaxVhr4UZLuNM Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Domain-Id: None Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Domain-Name: None Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Identity-Status: Confirmed Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Is-Admin-Project: True Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Project-Domain-Id: default Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Project-Domain-Name: Default Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Project-Id: 10580c2140c64e24a4fb1ff11f27a985 Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Project-Name: admin Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Role: reader,admin,member Jul 20 08:18:54.754411 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Roles: reader,admin,member Jul 20 08:18:54.756123 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/10580c2140c64e24a4fb1ff11f27a985"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/10580c2140c64e24a4fb1ff11f27a985"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_10580c2140c64e24a4fb1ff11f27a985", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/10580c2140c64e24a4fb1ff11f27a985"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:18:54.756123 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Tenant: admin Jul 20 08:18:54.756123 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Tenant-Id: 10580c2140c64e24a4fb1ff11f27a985 Jul 20 08:18:54.756123 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Tenant-Name: admin Jul 20 08:18:54.756123 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-User: admin Jul 20 08:18:54.756123 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-User-Domain-Id: default Jul 20 08:18:54.756123 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-User-Domain-Name: Default Jul 20 08:18:54.756123 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-User-Id: c5ec92316a2c452dab52aa49d7256f2f Jul 20 08:18:54.756123 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-User-Name: admin Jul 20 08:18:54.756123 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: method: > Jul 20 08:18:54.756123 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: exception: Flavor 42 could not be found. Jul 20 08:18:54.756123 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: action_args: {'id': '42'} Jul 20 08:18:54.756123 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:18:54.756123 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:18:54.757180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 08:18:54.757180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 08:18:54.757180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 08:18:54.757180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 08:18:54.757180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 08:18:54.757180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 08:18:54.757180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 08:18:54.757180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 08:18:54.757180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 08:18:54.757180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:18:54.757180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 08:18:54.757180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 08:18:54.757180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 08:18:54.757180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 20 08:18:54.757180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:18:54.757180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 20 08:18:54.757180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:18:54.757180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:18:54.757180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:18:54.758396 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:18:54.758396 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:18:54.758396 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:18:54.758396 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:18:54.758396 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 08:18:54.758396 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:18:54.758396 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 08:18:54.758396 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 20 08:18:54.758396 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:18:54.758396 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 20 08:18:54.758396 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:18:54.758396 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:18:54.758396 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:18:54.758396 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:18:54.758396 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:18:54.758396 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 08:18:54.758396 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 20 08:18:54.758396 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-ead02072-fbe0-4ed5-8de6-d73663fcb8f4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:18:54.759489 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-ead02072-fbe0-4ed5-8de6-d73663fcb8f4 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.438140 Jul 20 08:18:54.759489 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Jul 20 08:18:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 440 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 08:18:54.765993 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-0738ad20-29e1-4a51-8d1a-a2d9f1dbe8bb admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:54.790306 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-0738ad20-29e1-4a51-8d1a-a2d9f1dbe8bb admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027199 Jul 20 08:18:54.790920 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Jul 20 08:18:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:18:54.802994 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-5f12a868-2d8c-4f06-b32f-55e8ed37d08b admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:54.826976 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-5f12a868-2d8c-4f06-b32f-55e8ed37d08b admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027608 Jul 20 08:18:54.827569 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Jul 20 08:18:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:18:54.838148 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-7b811fc0-e241-45da-99ee-b63c55135ceb admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:54.844411 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.wsgi [None req-7b811fc0-e241-45da-99ee-b63c55135ceb admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-7b811fc0-e241-45da-99ee-b63c55135ceb admin admin] Request method failure captured: Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Accept: application/json Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Accept-Encoding: gzip, deflate Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Connection: keep-alive Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Content-Length: 0 Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Host: 10.222.0.64 Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Openstack-Api-Version: compute 2.90 Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Openstack-System-Scope: None Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: User-Agent: python-novaclient Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Auth-Token: gAAAAABi17puxaftXU30O4uqgZ1jwc2IZPn9SfJAGVR14RLA8wDb2eMed8cYkRMMAfyNyuSx6E5qlJqP0y11JXDhMiAsF70xoJ2myYoHJSn8D7PBuLT0Finv7zos7ofAyp_lc_F5hIIF5tNVuCJMlF1HLReyE3-C2Ri4hx2qAMjaxVhr4UZLuNM Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Domain-Id: None Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Domain-Name: None Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Identity-Status: Confirmed Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Is-Admin-Project: True Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Project-Domain-Id: default Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Project-Domain-Name: Default Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Project-Id: 10580c2140c64e24a4fb1ff11f27a985 Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Project-Name: admin Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Role: reader,admin,member Jul 20 08:18:54.847695 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Roles: reader,admin,member Jul 20 08:18:54.849978 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/10580c2140c64e24a4fb1ff11f27a985"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/10580c2140c64e24a4fb1ff11f27a985"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_10580c2140c64e24a4fb1ff11f27a985", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/10580c2140c64e24a4fb1ff11f27a985"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:18:54.849978 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Tenant: admin Jul 20 08:18:54.849978 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Tenant-Id: 10580c2140c64e24a4fb1ff11f27a985 Jul 20 08:18:54.849978 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Tenant-Name: admin Jul 20 08:18:54.849978 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-User: admin Jul 20 08:18:54.849978 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-User-Domain-Id: default Jul 20 08:18:54.849978 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-User-Domain-Name: Default Jul 20 08:18:54.849978 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-User-Id: c5ec92316a2c452dab52aa49d7256f2f Jul 20 08:18:54.849978 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-User-Name: admin Jul 20 08:18:54.849978 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: method: > Jul 20 08:18:54.849978 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: exception: Flavor 42 could not be found. Jul 20 08:18:54.849978 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: action_args: {'id': '42'} Jul 20 08:18:54.849978 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:18:54.849978 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:18:54.851628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 08:18:54.851628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 08:18:54.851628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 08:18:54.851628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 08:18:54.851628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 08:18:54.851628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 08:18:54.851628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 08:18:54.851628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 08:18:54.851628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 08:18:54.851628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:18:54.851628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 08:18:54.851628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 08:18:54.851628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 08:18:54.851628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 20 08:18:54.851628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:18:54.851628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 20 08:18:54.851628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:18:54.851628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:18:54.851628 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:18:54.854348 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:18:54.854348 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:18:54.854348 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:18:54.854348 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:18:54.854348 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 08:18:54.854348 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:18:54.854348 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 08:18:54.854348 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 20 08:18:54.854348 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:18:54.854348 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 20 08:18:54.854348 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:18:54.854348 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:18:54.854348 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:18:54.854348 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:18:54.854348 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:18:54.854348 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 08:18:54.854348 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 20 08:18:54.854348 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-7b811fc0-e241-45da-99ee-b63c55135ceb admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:18:54.856349 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-7b811fc0-e241-45da-99ee-b63c55135ceb admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015518 Jul 20 08:18:54.856349 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 22/42] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Jul 20 08:18:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 08:18:55.890622 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-5f12a868-2d8c-4f06-b32f-55e8ed37d08b admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:55.891633 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-5f12a868-2d8c-4f06-b32f-55e8ed37d08b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 20 08:18:55.892053 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 21/43] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Jul 20 08:18:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:18:56.442804 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-0e05fc9c-07c6-442f-92a5-5fc46e79ea0d admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:56.449446 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.wsgi [None req-0e05fc9c-07c6-442f-92a5-5fc46e79ea0d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-0e05fc9c-07c6-442f-92a5-5fc46e79ea0d admin admin] Request method failure captured: Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Accept: application/json Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Accept-Encoding: gzip, deflate Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Connection: keep-alive Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Content-Length: 0 Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Host: 10.222.0.64 Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Openstack-Api-Version: compute 2.90 Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Openstack-System-Scope: None Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: User-Agent: python-novaclient Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Auth-Token: gAAAAABi17pvRNymca-628dYcP91zwSM6L_MI8xdQ4C2wydxWVT16FQs69lURXwK3J1bC0ldI6MTKovlDS_Oa_9dlNW0IIqanHKEHiapQRLGgNCfXxaQBs2weEVVeB_ozN1sPzyz-Y2_zm0kE3EHuPUZHf2Aqkfbasmb3atskER5NltuKCOM_cY Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Domain-Id: None Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Domain-Name: None Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Identity-Status: Confirmed Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Is-Admin-Project: True Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Project-Domain-Id: default Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Project-Domain-Name: Default Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Project-Id: 10580c2140c64e24a4fb1ff11f27a985 Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Project-Name: admin Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Role: reader,admin,member Jul 20 08:18:56.451001 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Roles: reader,admin,member Jul 20 08:18:56.452583 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/10580c2140c64e24a4fb1ff11f27a985"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/10580c2140c64e24a4fb1ff11f27a985"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_10580c2140c64e24a4fb1ff11f27a985", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/10580c2140c64e24a4fb1ff11f27a985"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:18:56.452583 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Tenant: admin Jul 20 08:18:56.452583 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Tenant-Id: 10580c2140c64e24a4fb1ff11f27a985 Jul 20 08:18:56.452583 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Tenant-Name: admin Jul 20 08:18:56.452583 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-User: admin Jul 20 08:18:56.452583 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-User-Domain-Id: default Jul 20 08:18:56.452583 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-User-Domain-Name: Default Jul 20 08:18:56.452583 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-User-Id: c5ec92316a2c452dab52aa49d7256f2f Jul 20 08:18:56.452583 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-User-Name: admin Jul 20 08:18:56.452583 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: method: > Jul 20 08:18:56.452583 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: exception: Flavor 84 could not be found. Jul 20 08:18:56.452583 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: action_args: {'id': '84'} Jul 20 08:18:56.452583 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:18:56.452583 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:18:56.453423 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 08:18:56.453423 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 08:18:56.453423 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 08:18:56.453423 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 08:18:56.453423 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 08:18:56.453423 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 08:18:56.453423 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 08:18:56.453423 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 08:18:56.453423 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 08:18:56.453423 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:18:56.453423 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 08:18:56.453423 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 08:18:56.453423 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 08:18:56.453423 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 20 08:18:56.453423 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:18:56.453423 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 20 08:18:56.453423 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:18:56.453423 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:18:56.453423 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:18:56.454546 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:18:56.454546 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:18:56.454546 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:18:56.454546 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:18:56.454546 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 08:18:56.454546 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:18:56.454546 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 08:18:56.454546 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 20 08:18:56.454546 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:18:56.454546 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 20 08:18:56.454546 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:18:56.454546 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:18:56.454546 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:18:56.454546 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:18:56.454546 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:18:56.454546 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 08:18:56.454546 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 20 08:18:56.454546 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-0e05fc9c-07c6-442f-92a5-5fc46e79ea0d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:18:56.455771 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-0e05fc9c-07c6-442f-92a5-5fc46e79ea0d admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.421107 Jul 20 08:18:56.455771 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Jul 20 08:18:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 422 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 08:18:56.462751 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-f58c926c-7b92-4dee-8e1d-67b0173144de admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:56.476584 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-f58c926c-7b92-4dee-8e1d-67b0173144de admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018014 Jul 20 08:18:56.477492 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Jul 20 08:18:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:18:56.487794 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-07a6f768-a023-4294-8dee-f1d93f1d7918 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:56.503841 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-07a6f768-a023-4294-8dee-f1d93f1d7918 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020228 Jul 20 08:18:56.504404 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Jul 20 08:18:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:18:56.514785 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-8d2f7401-1cb0-4e3a-adcf-ae73022d705b admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:56.520326 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.wsgi [None req-8d2f7401-1cb0-4e3a-adcf-ae73022d705b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-8d2f7401-1cb0-4e3a-adcf-ae73022d705b admin admin] Request method failure captured: Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Accept: application/json Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Accept-Encoding: gzip, deflate Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Connection: keep-alive Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Content-Length: 0 Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Host: 10.222.0.64 Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Openstack-Api-Version: compute 2.90 Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Openstack-System-Scope: None Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: User-Agent: python-novaclient Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Auth-Token: gAAAAABi17pvRNymca-628dYcP91zwSM6L_MI8xdQ4C2wydxWVT16FQs69lURXwK3J1bC0ldI6MTKovlDS_Oa_9dlNW0IIqanHKEHiapQRLGgNCfXxaQBs2weEVVeB_ozN1sPzyz-Y2_zm0kE3EHuPUZHf2Aqkfbasmb3atskER5NltuKCOM_cY Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Domain-Id: None Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Domain-Name: None Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Identity-Status: Confirmed Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Is-Admin-Project: True Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Project-Domain-Id: default Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Project-Domain-Name: Default Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Project-Id: 10580c2140c64e24a4fb1ff11f27a985 Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Project-Name: admin Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Role: reader,admin,member Jul 20 08:18:56.521836 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Roles: reader,admin,member Jul 20 08:18:56.523431 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/10580c2140c64e24a4fb1ff11f27a985"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/10580c2140c64e24a4fb1ff11f27a985"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_10580c2140c64e24a4fb1ff11f27a985", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/10580c2140c64e24a4fb1ff11f27a985"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:18:56.523431 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Tenant: admin Jul 20 08:18:56.523431 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Tenant-Id: 10580c2140c64e24a4fb1ff11f27a985 Jul 20 08:18:56.523431 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Tenant-Name: admin Jul 20 08:18:56.523431 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-User: admin Jul 20 08:18:56.523431 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-User-Domain-Id: default Jul 20 08:18:56.523431 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-User-Domain-Name: Default Jul 20 08:18:56.523431 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-User-Id: c5ec92316a2c452dab52aa49d7256f2f Jul 20 08:18:56.523431 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-User-Name: admin Jul 20 08:18:56.523431 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: method: > Jul 20 08:18:56.523431 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: exception: Flavor 84 could not be found. Jul 20 08:18:56.523431 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: action_args: {'id': '84'} Jul 20 08:18:56.523431 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:18:56.523431 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:18:56.525115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 08:18:56.525115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 08:18:56.525115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 08:18:56.525115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 08:18:56.525115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 08:18:56.525115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 08:18:56.525115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 08:18:56.525115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 08:18:56.525115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 08:18:56.525115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:18:56.525115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 08:18:56.525115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 08:18:56.525115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 08:18:56.525115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 20 08:18:56.525115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:18:56.525115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 20 08:18:56.525115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:18:56.525115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:18:56.525115 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:18:56.526447 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:18:56.526447 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:18:56.526447 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:18:56.526447 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:18:56.526447 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 08:18:56.526447 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:18:56.526447 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 08:18:56.526447 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 20 08:18:56.526447 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:18:56.526447 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 20 08:18:56.526447 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:18:56.526447 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:18:56.526447 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:18:56.526447 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:18:56.526447 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:18:56.526447 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 08:18:56.526447 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 20 08:18:56.526447 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-8d2f7401-1cb0-4e3a-adcf-ae73022d705b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:18:56.527750 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-8d2f7401-1cb0-4e3a-adcf-ae73022d705b admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012125 Jul 20 08:18:56.527750 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 23/47] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Jul 20 08:18:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 20 08:18:57.531959 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-07a6f768-a023-4294-8dee-f1d93f1d7918 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:57.533144 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-07a6f768-a023-4294-8dee-f1d93f1d7918 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jul 20 08:18:57.533447 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 25/48] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Jul 20 08:18:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:18:58.117843 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-9f25079b-7b14-4a46-b306-bb6bd40334a4 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:58.124388 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.wsgi [None req-9f25079b-7b14-4a46-b306-bb6bd40334a4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-9f25079b-7b14-4a46-b306-bb6bd40334a4 admin admin] Request method failure captured: Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Accept: application/json Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Accept-Encoding: gzip, deflate Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Connection: keep-alive Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Content-Length: 0 Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Host: 10.222.0.64 Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Openstack-Api-Version: compute 2.90 Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Openstack-System-Scope: None Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: User-Agent: python-novaclient Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Auth-Token: gAAAAABi17pxz8CxVHi4ylDuGR7i2lu-24nBJgcQ_G2-64fTUqoC17Y7y_S_rWoqFxugmP94ewP_6zs5-7LIxgqnGKPkV04Khk34UzHK4nKJt2kINrRFbHIdUzjQfeZt2Y17tc68RHljWDhcDTRpoAc5UsFC9px8k4ch-2PqsSGsxCFjhGdyxOo Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Domain-Id: None Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Domain-Name: None Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Identity-Status: Confirmed Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Is-Admin-Project: True Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Project-Domain-Id: default Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Project-Domain-Name: Default Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Project-Id: 10580c2140c64e24a4fb1ff11f27a985 Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Project-Name: admin Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Role: reader,admin,member Jul 20 08:18:58.125915 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Roles: reader,admin,member Jul 20 08:18:58.127291 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/10580c2140c64e24a4fb1ff11f27a985"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/10580c2140c64e24a4fb1ff11f27a985"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_10580c2140c64e24a4fb1ff11f27a985", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/10580c2140c64e24a4fb1ff11f27a985"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:18:58.127291 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Tenant: admin Jul 20 08:18:58.127291 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Tenant-Id: 10580c2140c64e24a4fb1ff11f27a985 Jul 20 08:18:58.127291 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-Tenant-Name: admin Jul 20 08:18:58.127291 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-User: admin Jul 20 08:18:58.127291 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-User-Domain-Id: default Jul 20 08:18:58.127291 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-User-Domain-Name: Default Jul 20 08:18:58.127291 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-User-Id: c5ec92316a2c452dab52aa49d7256f2f Jul 20 08:18:58.127291 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: X-User-Name: admin Jul 20 08:18:58.127291 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: method: > Jul 20 08:18:58.127291 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: exception: Flavor 451 could not be found. Jul 20 08:18:58.127291 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: action_args: {'id': '451'} Jul 20 08:18:58.127291 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:18:58.127291 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:18:58.129211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 08:18:58.129211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 08:18:58.129211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 08:18:58.129211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 08:18:58.129211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 08:18:58.129211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 08:18:58.129211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 08:18:58.129211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 08:18:58.129211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 08:18:58.129211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:18:58.129211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 08:18:58.129211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 08:18:58.129211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 08:18:58.129211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 20 08:18:58.129211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:18:58.129211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 20 08:18:58.129211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:18:58.129211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:18:58.129211 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:18:58.130722 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:18:58.130722 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:18:58.130722 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:18:58.130722 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:18:58.130722 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 08:18:58.130722 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:18:58.130722 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 08:18:58.130722 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 20 08:18:58.130722 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:18:58.130722 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 20 08:18:58.130722 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:18:58.130722 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:18:58.130722 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:18:58.130722 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:18:58.130722 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:18:58.130722 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 08:18:58.130722 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: ERROR nova.api.openstack.wsgi Jul 20 08:18:58.130722 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-9f25079b-7b14-4a46-b306-bb6bd40334a4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:18:58.132082 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-9f25079b-7b14-4a46-b306-bb6bd40334a4 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.450945 Jul 20 08:18:58.132082 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Jul 20 08:18:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 452 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 20 08:18:58.137891 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-84658941-3e7e-4702-b73b-c672991770f8 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:58.152461 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-84658941-3e7e-4702-b73b-c672991770f8 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018250 Jul 20 08:18:58.153026 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 26/50] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Jul 20 08:18:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:18:58.162886 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-f1dfc103-fb1d-4abd-aa00-b9814ebb1887 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:58.176847 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-f1dfc103-fb1d-4abd-aa00-b9814ebb1887 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017543 Jul 20 08:18:58.177415 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 25/51] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Jul 20 08:18:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:18:58.187395 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-455b90a6-059f-427e-8784-b4da34496503 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:58.195996 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.wsgi [None req-455b90a6-059f-427e-8784-b4da34496503 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-455b90a6-059f-427e-8784-b4da34496503 admin admin] Request method failure captured: Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Accept: application/json Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Accept-Encoding: gzip, deflate Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Connection: keep-alive Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Content-Length: 0 Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Host: 10.222.0.64 Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Openstack-Api-Version: compute 2.90 Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Openstack-System-Scope: None Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: User-Agent: python-novaclient Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Auth-Token: gAAAAABi17pxz8CxVHi4ylDuGR7i2lu-24nBJgcQ_G2-64fTUqoC17Y7y_S_rWoqFxugmP94ewP_6zs5-7LIxgqnGKPkV04Khk34UzHK4nKJt2kINrRFbHIdUzjQfeZt2Y17tc68RHljWDhcDTRpoAc5UsFC9px8k4ch-2PqsSGsxCFjhGdyxOo Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Domain-Id: None Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Domain-Name: None Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Identity-Status: Confirmed Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Is-Admin-Project: True Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Project-Domain-Id: default Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Project-Domain-Name: Default Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Project-Id: 10580c2140c64e24a4fb1ff11f27a985 Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Project-Name: admin Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Role: reader,admin,member Jul 20 08:18:58.197902 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Roles: reader,admin,member Jul 20 08:18:58.199493 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/10580c2140c64e24a4fb1ff11f27a985"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/10580c2140c64e24a4fb1ff11f27a985"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_10580c2140c64e24a4fb1ff11f27a985", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/10580c2140c64e24a4fb1ff11f27a985"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:18:58.199493 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Tenant: admin Jul 20 08:18:58.199493 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Tenant-Id: 10580c2140c64e24a4fb1ff11f27a985 Jul 20 08:18:58.199493 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-Tenant-Name: admin Jul 20 08:18:58.199493 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-User: admin Jul 20 08:18:58.199493 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-User-Domain-Id: default Jul 20 08:18:58.199493 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-User-Domain-Name: Default Jul 20 08:18:58.199493 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-User-Id: c5ec92316a2c452dab52aa49d7256f2f Jul 20 08:18:58.199493 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: X-User-Name: admin Jul 20 08:18:58.199493 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: method: > Jul 20 08:18:58.199493 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: exception: Flavor 451 could not be found. Jul 20 08:18:58.199493 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: action_args: {'id': '451'} Jul 20 08:18:58.199493 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:18:58.199493 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:18:58.200437 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 08:18:58.200437 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 08:18:58.200437 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 08:18:58.200437 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 08:18:58.200437 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 08:18:58.200437 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 08:18:58.200437 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 08:18:58.200437 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 08:18:58.200437 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 08:18:58.200437 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:18:58.200437 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 08:18:58.200437 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 08:18:58.200437 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 08:18:58.200437 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 20 08:18:58.200437 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:18:58.200437 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 20 08:18:58.200437 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:18:58.200437 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:18:58.200437 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:18:58.201536 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:18:58.201536 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:18:58.201536 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:18:58.201536 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:18:58.201536 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 08:18:58.201536 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:18:58.201536 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 08:18:58.201536 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 20 08:18:58.201536 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:18:58.201536 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 20 08:18:58.201536 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:18:58.201536 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:18:58.201536 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:18:58.201536 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:18:58.201536 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:18:58.201536 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 08:18:58.201536 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: ERROR nova.api.openstack.wsgi Jul 20 08:18:58.201536 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-455b90a6-059f-427e-8784-b4da34496503 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103271) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:18:58.202553 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-455b90a6-059f-427e-8784-b4da34496503 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.015712 Jul 20 08:18:58.202553 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 27/52] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Jul 20 08:18:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 08:18:59.202669 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-f1dfc103-fb1d-4abd-aa00-b9814ebb1887 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:18:59.203681 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-f1dfc103-fb1d-4abd-aa00-b9814ebb1887 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 20 08:18:59.204082 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Jul 20 08:18:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:18:59.772289 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-2169b6f6-7f3b-47c5-82ac-e92fb41ecc0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:18:59.791609 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-2169b6f6-7f3b-47c5-82ac-e92fb41ecc0d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.439992 Jul 20 08:18:59.792153 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 28/54] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Jul 20 08:18:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:19:00.827059 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-f1dfc103-fb1d-4abd-aa00-b9814ebb1887 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:19:00.828073 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-f1dfc103-fb1d-4abd-aa00-b9814ebb1887 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 20 08:19:00.828489 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Jul 20 08:19:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:19:01.463111 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-ba6f1b4d-7921-44e8-b6e5-11291c6ec8c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:19:01.481551 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-ba6f1b4d-7921-44e8-b6e5-11291c6ec8c1 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.501313 Jul 20 08:19:01.482105 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 29/56] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Jul 20 08:19:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 08:19:02.506552 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-f1dfc103-fb1d-4abd-aa00-b9814ebb1887 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:19:02.509180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-f1dfc103-fb1d-4abd-aa00-b9814ebb1887 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jul 20 08:19:02.509180 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Jul 20 08:19:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:19:03.191426 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-0df59d71-6931-4f33-8dab-8f32bcfe3601 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:19:03.210042 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-0df59d71-6931-4f33-8dab-8f32bcfe3601 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.562508 Jul 20 08:19:03.210636 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Jul 20 08:19:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:19:04.213858 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-f1dfc103-fb1d-4abd-aa00-b9814ebb1887 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:19:04.214914 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-f1dfc103-fb1d-4abd-aa00-b9814ebb1887 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 20 08:19:04.217168 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 29/59] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Jul 20 08:19:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:19:04.785130 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-31716470-36d4-4b8a-b6e3-1914c803899d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:19:04.804075 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-31716470-36d4-4b8a-b6e3-1914c803899d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.433121 Jul 20 08:19:04.805411 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 31/60] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Jul 20 08:19:04 2022] POST /compute/v2.1/flavors => generated 409 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:19:05.817605 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-f1dfc103-fb1d-4abd-aa00-b9814ebb1887 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:19:05.818856 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-f1dfc103-fb1d-4abd-aa00-b9814ebb1887 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001695 Jul 20 08:19:05.819332 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 30/61] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Jul 20 08:19:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:19:06.366807 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-50afe7f9-9569-4904-8d44-eb125b87e852 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:19:06.387199 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-50afe7f9-9569-4904-8d44-eb125b87e852 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.427632 Jul 20 08:19:06.387762 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1202 bytes} [Wed Jul 20 08:19:05 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:20:00.279080 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-f1dfc103-fb1d-4abd-aa00-b9814ebb1887 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:20:00.280035 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-f1dfc103-fb1d-4abd-aa00-b9814ebb1887 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 20 08:20:00.280438 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 31/63] 10.222.0.64 () {54 vars in 930 bytes} [Wed Jul 20 08:20:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:20:00.291999 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:20:00.692635 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-98ad7b4b-1230-475a-8cdf-2622b0eb6202 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:20:00.712569 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-98ad7b4b-1230-475a-8cdf-2622b0eb6202 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.425943 Jul 20 08:20:00.713129 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1291 bytes} [Wed Jul 20 08:20:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:20:00.734422 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG dbcounter [-] [103272] Writing DB stats nova_api:SELECT=14 {{(pid=103272) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:20:00.738307 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-4bdac8f3-f88a-445e-8d9e-ab65e83785f3 admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:20:00.746854 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-4bdac8f3-f88a-445e-8d9e-ab65e83785f3 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013760 Jul 20 08:20:00.747415 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 32/65] 10.222.0.64 () {60 vars in 1282 bytes} [Wed Jul 20 08:20:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:20:00.759167 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-57c8ce70-ed7b-4d0b-8d03-a8973ba51f66 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:20:00.766974 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-57c8ce70-ed7b-4d0b-8d03-a8973ba51f66 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011335 Jul 20 08:20:00.767513 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 34/66] 10.222.0.64 () {60 vars in 1285 bytes} [Wed Jul 20 08:20:00 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:20:00.779648 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-e5224c55-1fb0-4d4f-841d-82df813875db admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:20:00.788567 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-e5224c55-1fb0-4d4f-841d-82df813875db admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012441 Jul 20 08:20:00.789054 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1285 bytes} [Wed Jul 20 08:20:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:20:00.800963 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-2d73aff6-1a95-4935-beb9-15ac8f67f866 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:20:00.809118 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-2d73aff6-1a95-4935-beb9-15ac8f67f866 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011853 Jul 20 08:20:00.809664 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 35/68] 10.222.0.64 () {60 vars in 1282 bytes} [Wed Jul 20 08:20:00 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:23:30.373825 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-e5224c55-1fb0-4d4f-841d-82df813875db admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:23:30.374857 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-e5224c55-1fb0-4d4f-841d-82df813875db admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 20 08:23:30.375329 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 34/69] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Jul 20 08:23:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:23:30.517027 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=6 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:23:30.684673 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-93d8649e-a78c-4ae6-b233-dba876315d6d admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:23:30.685850 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 08:23:30.685850 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: warnings.warn(msg) Jul 20 08:23:30.687102 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-93d8649e-a78c-4ae6-b233-dba876315d6d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:23:30.687544 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-93d8649e-a78c-4ae6-b233-dba876315d6d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:23:30.688363 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-93d8649e-a78c-4ae6-b233-dba876315d6d admin admin] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:23:30.688792 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-93d8649e-a78c-4ae6-b233-dba876315d6d admin admin] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:23:30.724195 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-93d8649e-a78c-4ae6-b233-dba876315d6d admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.208611 Jul 20 08:23:30.724979 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 36/70] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Jul 20 08:23:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:23:31.589446 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-e5224c55-1fb0-4d4f-841d-82df813875db admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:23:31.590478 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-e5224c55-1fb0-4d4f-841d-82df813875db admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001587 Jul 20 08:23:31.591123 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 35/71] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Jul 20 08:23:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:23:31.785097 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-a8016e8d-7849-401a-912e-7c8144266eca admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:23:31.786265 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 08:23:31.786265 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: warnings.warn(msg) Jul 20 08:23:31.787488 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-a8016e8d-7849-401a-912e-7c8144266eca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:23:31.787914 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-a8016e8d-7849-401a-912e-7c8144266eca admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:23:31.788703 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-a8016e8d-7849-401a-912e-7c8144266eca admin admin] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:23:31.789128 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-a8016e8d-7849-401a-912e-7c8144266eca admin admin] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:23:31.808800 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-a8016e8d-7849-401a-912e-7c8144266eca admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074994 Jul 20 08:23:31.809371 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 37/72] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Jul 20 08:23:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 08:23:43.045165 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-e5224c55-1fb0-4d4f-841d-82df813875db admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:23:43.046168 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-e5224c55-1fb0-4d4f-841d-82df813875db admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 20 08:23:43.046566 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 36/73] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Jul 20 08:23:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:23:43.190225 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell0:SELECT=4 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:23:43.190959 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_cell1:SELECT=4 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:23:43.191562 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG dbcounter [-] [103271] Writing DB stats nova_api:SELECT=8 {{(pid=103271) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:23:43.243150 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-16f8dae8-0352-4f26-946a-51b7ff780bf3 admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:23:43.244307 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 08:23:43.244307 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: warnings.warn(msg) Jul 20 08:23:43.246316 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-16f8dae8-0352-4f26-946a-51b7ff780bf3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:23:43.246778 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-16f8dae8-0352-4f26-946a-51b7ff780bf3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:23:43.247603 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-16f8dae8-0352-4f26-946a-51b7ff780bf3 admin admin] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:23:43.247992 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-16f8dae8-0352-4f26-946a-51b7ff780bf3 admin admin] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:23:43.273629 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-16f8dae8-0352-4f26-946a-51b7ff780bf3 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087653 Jul 20 08:23:43.274109 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 38/74] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Jul 20 08:23:43 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:23:44.139900 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: DEBUG nova.api.openstack.wsgi [None req-e5224c55-1fb0-4d4f-841d-82df813875db admin admin] Calling method '>' {{(pid=103272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:23:44.140905 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: INFO nova.api.openstack.requestlog [None req-e5224c55-1fb0-4d4f-841d-82df813875db admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 20 08:23:44.141306 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: [pid: 103272|app: 0|req: 37/75] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Jul 20 08:23:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:23:44.333698 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG nova.api.openstack.wsgi [None req-d9bf6f5d-ad1a-4ee5-b7c9-a7eef2f8ff8a admin admin] Calling method '>' {{(pid=103271) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:23:44.334937 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 08:23:44.334937 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: warnings.warn(msg) Jul 20 08:23:44.336102 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-d9bf6f5d-ad1a-4ee5-b7c9-a7eef2f8ff8a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:23:44.336609 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-d9bf6f5d-ad1a-4ee5-b7c9-a7eef2f8ff8a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:23:44.337479 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-d9bf6f5d-ad1a-4ee5-b7c9-a7eef2f8ff8a admin admin] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:23:44.337920 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: DEBUG oslo_concurrency.lockutils [None req-d9bf6f5d-ad1a-4ee5-b7c9-a7eef2f8ff8a admin admin] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103271) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:23:44.360641 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: INFO nova.api.openstack.requestlog [None req-d9bf6f5d-ad1a-4ee5-b7c9-a7eef2f8ff8a admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079816 Jul 20 08:23:44.361203 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: [pid: 103271|app: 0|req: 39/76] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Jul 20 08:23:44 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:24:43.595894 dv-cinder-823089-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 20 08:24:43.596468 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: Wed Jul 20 08:24:43 2022 - graceful shutdown triggered... Jul 20 08:24:43.596906 dv-cinder-823089-3-iscsi devstack@n-api.service[103271]: Gracefully killing worker 1 (pid: 103271)... Jul 20 08:24:43.597257 dv-cinder-823089-3-iscsi devstack@n-api.service[103272]: Gracefully killing worker 2 (pid: 103272)... Jul 20 08:24:44.597600 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: worker 1 buried after 1 seconds Jul 20 08:24:44.598128 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: worker 2 buried after 1 seconds Jul 20 08:24:44.598128 dv-cinder-823089-3-iscsi devstack@n-api.service[103270]: goodbye to uWSGI. Jul 20 08:24:44.599257 dv-cinder-823089-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 20 08:24:44.599841 dv-cinder-823089-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 20 08:24:44.602627 dv-cinder-823089-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 08:24:44.613988 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 08:24:44.616163 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 08:24:44 2022] *** Jul 20 08:24:44.616163 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 08:24:44.616163 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 08:24:44.616163 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: nodename: dv-cinder-823089-3-iscsi Jul 20 08:24:44.616163 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: machine: x86_64 Jul 20 08:24:44.616163 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: clock source: unix Jul 20 08:24:44.616163 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: pcre jit disabled Jul 20 08:24:44.616163 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: detected number of CPU cores: 4 Jul 20 08:24:44.616163 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: current working directory: / Jul 20 08:24:44.616163 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: detected binary path: /usr/bin/uwsgi-core Jul 20 08:24:44.616931 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: your processes number limit is 47680 Jul 20 08:24:44.616931 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: your memory page size is 4096 bytes Jul 20 08:24:44.616931 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: detected max file descriptor number: 2048 Jul 20 08:24:44.616931 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: lock engine: pthread robust mutexes Jul 20 08:24:44.616931 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: thunder lock: enabled Jul 20 08:24:44.616931 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 08:24:44.616931 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 08:24:44.661761 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: Python main interpreter initialized at 0x557ffd0109c0 Jul 20 08:24:44.661761 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: python threads support enabled Jul 20 08:24:44.661761 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: your server socket listen backlog is limited to 100 connections Jul 20 08:24:44.661761 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: your mercy for graceful operations on workers is 90 seconds Jul 20 08:24:44.662231 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 08:24:44.662231 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: *** Operational MODE: preforking *** Jul 20 08:24:44.665732 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: *** uWSGI is running in multiple interpreter mode *** Jul 20 08:24:44.665732 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: spawned uWSGI master process (pid: 117809) Jul 20 08:24:44.665732 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: spawned uWSGI worker 1 (pid: 117828, cores: 1) Jul 20 08:24:44.665732 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: spawned uWSGI worker 2 (pid: 117829, cores: 1) Jul 20 08:24:44.665732 dv-cinder-823089-3-iscsi devstack@n-api.service[117809]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 08:24:44.662530 dv-cinder-823089-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 08:24:45.338592 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 08:24:45.339595 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 08:24:46.556891 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 08:24:46.556891 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: from cryptography.utils import int_from_bytes Jul 20 08:24:46.558053 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 08:24:46.558053 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: from cryptography.utils import int_from_bytes Jul 20 08:24:46.565497 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 08:24:46.565497 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: from cryptography.utils import int_from_bytes Jul 20 08:24:46.566096 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 08:24:46.566096 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: from cryptography.utils import int_from_bytes Jul 20 08:24:48.934697 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 08:24:48.935280 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 08:24:48.935577 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 08:24:48.935788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 08:24:48.936060 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 08:24:48.936433 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.936760 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.937082 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.937402 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.937733 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.938045 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.938374 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.938746 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.939080 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.939341 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.939663 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.939986 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-823089-3-iscsi {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.940308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.940616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.940928 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.941253 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.941552 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.941874 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.942182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.942727 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.944129 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.944129 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.944129 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.944401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.944714 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.945029 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.945336 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.945659 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.945934 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 08:24:48.946402 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.946504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 08:24:48.946770 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.946770 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-823089-3-iscsi {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.947233 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 08:24:48.947477 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.947681 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 08:24:48.947929 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.948148 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 08:24:48.948385 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.948603 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.948820 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.949049 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.949270 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.949489 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.949707 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.949930 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.950150 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.950377 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.950563 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.950820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.950969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.951167 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.951332 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.951511 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.951666 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.951823 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.951823 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.952116 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.952312 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.952464 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.952609 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-823089-3-iscsi {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.952752 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.952905 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.953066 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.953228 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.953381 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.953569 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.953727 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.953879 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.954031 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.954225 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.954480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.954480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.954924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.955084 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.955231 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.955403 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.955551 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.955758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.955914 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.956066 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.957082 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.957246 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.957412 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.957571 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.957571 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.957878 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.958032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.958187 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.958352 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.958507 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.958735 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.958974 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.962675 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.962881 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.963049 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.963210 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.963359 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.963527 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.963720 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.963884 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-823089-3-iscsi {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.964040 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.964193 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.964353 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.964507 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.964662 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.964818 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.964972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.965131 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.965278 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.965429 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.965593 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.965738 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.965889 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.966054 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.966222 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.966396 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.966604 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.966798 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.967362 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.967523 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.967680 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.967832 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.967978 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.968147 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.968300 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.968462 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.968614 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.968769 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.968769 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.969050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.969206 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.969362 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.969514 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.969514 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.969514 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.970451 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.970663 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.970827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.970981 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.971132 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.971278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.971430 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.971593 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.971739 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.971894 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.972049 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.972202 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.972370 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.972522 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.972669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.972822 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.972974 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.973125 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.973285 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.973430 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.977205 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.978062 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.978234 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.978410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.978606 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.978778 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.978928 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.979085 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.979252 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.979404 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.979552 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.979696 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.979839 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.979983 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.980141 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.980295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.980447 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.980604 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.980759 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.980915 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.981084 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.981231 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.981384 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.981545 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.981693 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.981922 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.982092 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.982239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.982391 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.982548 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.982732 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.982885 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.983046 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.983237 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.983392 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.983556 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.983734 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.983909 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.984092 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.985159 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.985332 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.985460 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.986224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.986472 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.986764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.987030 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.987377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.987571 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.987738 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.987940 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.988108 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.988263 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.988418 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.988600 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.988759 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.988929 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.989077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.989338 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.989509 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.989665 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.989856 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.990007 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.990007 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.990007 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.990374 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.990502 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.990870 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.991026 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.991026 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.991026 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.991026 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.991026 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.991026 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.991026 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.991026 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.992422 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.992422 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.992422 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.992422 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.992422 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.992422 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.992422 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.992422 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.993560 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.993560 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.993560 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.993989 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.994141 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.994352 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.995497 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.995497 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.995497 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.995497 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.996074 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.996225 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.996646 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.996835 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.996835 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.996835 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.996835 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.996835 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.997638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.997792 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.997946 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.998102 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.998248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.998411 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.998411 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.998813 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.998973 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.998973 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.998973 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.998973 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.998973 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.998973 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.998973 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:48.998973 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:49.000321 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:49.000494 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:49.000666 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:49.000863 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.001025 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:49.001179 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.001331 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:49.001490 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.001644 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 08:24:49.001798 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.001798 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.002081 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.002225 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.002379 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.002534 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.010459 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.010727 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.010727 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.011045 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.011204 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.011361 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.011520 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.011673 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.011829 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.011986 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.012134 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.012294 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.012455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.012455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.012740 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.012895 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.013040 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.013185 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.013329 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.013472 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.013634 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.013788 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.013944 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.014099 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.014256 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.014415 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.014569 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.014795 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.014962 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.015116 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.015263 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.015407 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.015558 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.015704 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.015861 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.016013 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.016173 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.016341 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.016341 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.016638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.023861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.024667 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.024829 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.024993 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.025161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.025325 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.025483 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.025631 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.025778 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.025944 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.026108 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.026258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.026403 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.026554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.026758 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.026914 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.027084 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.027230 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.027386 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.027532 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.027684 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.027843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.028009 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.028162 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.028314 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.028470 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.028615 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.028781 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.028928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.028928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.029248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.029410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.029557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.029715 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.029868 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.030033 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.030178 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.030333 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.030485 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.030666 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.030826 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.030980 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.031125 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.031374 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.031545 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.031692 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.031842 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.032003 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.032148 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.032292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.033249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.034020 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.034184 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.034332 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.034477 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.034652 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.034822 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.034977 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.035123 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.035276 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.035442 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.035588 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.035816 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.035986 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.036143 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.036307 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.036464 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.036609 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.036767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.036920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.036920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.037214 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.037544 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.037717 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.037873 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.038019 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.038173 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.038327 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.038472 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.038678 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.038869 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.039028 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.039173 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.039317 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.039469 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.039624 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.039789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.039935 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.040087 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.040244 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.040399 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.040554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.040699 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.040843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.040987 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.041139 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.041299 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.041543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.041719 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.041873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.042065 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.042225 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.042382 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.042529 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.042714 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.042862 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.043006 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.043325 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.044101 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.044101 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.044458 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.044458 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.044806 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.044952 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.045111 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.045258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.045258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.045574 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.045721 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.045875 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.045875 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.046175 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.046323 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.046469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.046653 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.046827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.046974 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.047136 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.047292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.047445 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.047589 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.047749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.047904 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.048092 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.048240 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.048393 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.048545 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.048714 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.048861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.049013 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.049166 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.049319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.049474 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.049620 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.049772 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.049918 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.050071 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.050217 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.050380 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.050536 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.050756 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.050913 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.051067 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.051212 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.051366 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.051614 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.051777 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.051924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.052076 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.052221 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.052375 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.052529 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.052684 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.052837 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.052984 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.053137 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.053495 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.054097 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.054364 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.054525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.054713 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.054870 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.055025 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.055179 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.055335 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.055498 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.055652 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.055812 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.055958 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.056118 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.056274 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.056435 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.056588 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.056747 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.056900 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.056900 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.056900 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.057361 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.057529 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.057682 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.057828 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.057981 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.058134 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.058288 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.058447 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.058618 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.058769 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.058925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.059071 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.059223 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.059384 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.059384 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.059688 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.059840 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.059985 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.060135 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.060290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.060443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.060587 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.060876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.061037 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.061183 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.061344 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.061491 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.061756 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.061909 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.062062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.062218 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.062370 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.062517 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.062729 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.062886 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.063039 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.063193 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.063349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.063662 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.064254 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.064514 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.064668 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.064823 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.064970 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.065121 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.065274 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.065428 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.065576 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.065730 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.065876 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.066027 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.066027 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.066341 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.066501 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.066669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.066828 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.066828 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.067112 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.067263 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.067423 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.067569 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.067721 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.067873 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.068028 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.068173 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.068337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.068483 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.068628 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.068773 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.069069 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.069222 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.069367 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.069555 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.069717 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.069875 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.070033 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.070180 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.070345 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.070498 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.070704 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.070956 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.071119 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.071267 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.071419 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.071565 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.071717 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.071976 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.072132 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.072132 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.072428 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.072586 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.072739 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.072893 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.073047 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.073194 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.073338 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.073482 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.073762 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.073944 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.074818 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.074989 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.075137 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.075303 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.075457 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.075695 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.075844 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.075990 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.076153 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.076309 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.076455 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.076614 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.076760 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.076904 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.077064 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.077211 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.077368 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.077522 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.077675 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.077829 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.078186 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.078341 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.078497 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.078704 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.078855 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.079008 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.079008 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.079809 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.079966 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.080125 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.080272 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.081480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.081647 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.081804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.082080 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.082240 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.082396 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.082559 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.082784 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.082945 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.082945 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.083253 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.083407 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.083576 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.083759 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.084044 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.084216 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.085079 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.085247 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.085405 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.085554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.085784 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.085936 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.086116 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.086273 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.086421 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.086567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.086737 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.086950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.087114 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.087269 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.087423 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.087588 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.087757 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.087968 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.088118 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.088289 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.088449 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.088651 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.088819 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.089020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.089185 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.089185 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.089185 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.089621 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.089789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.089942 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.090134 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.090298 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.090463 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.090644 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.090810 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.090933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.091084 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.091084 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.091582 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.091734 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.091902 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.092328 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.092494 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.092654 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.092816 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.093002 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.093433 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.093607 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.093770 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.093934 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.094227 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.094388 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.096176 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.096367 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.096367 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.096691 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.096853 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.097021 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.097202 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.098014 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.098191 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.098355 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.098516 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.098762 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.098762 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.099061 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.099234 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.099388 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.099540 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.099691 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.099855 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.100014 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.100177 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.100329 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.100482 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.100633 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.100793 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.100945 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.101116 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.101271 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.101271 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.101734 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.101888 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.102095 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.102095 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.102502 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.102693 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.102857 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.103010 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.103170 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.103325 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.103699 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.103875 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.104029 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.104209 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.104517 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.104517 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.104836 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.104997 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.105149 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.105310 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.105471 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.105673 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.106172 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.106434 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.106644 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.106824 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.106987 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.107159 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.107312 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.107470 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.107634 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.107801 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.107962 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.108114 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.108266 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.108424 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.108577 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.108743 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.108903 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.109056 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.109225 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.109386 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.109539 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.109704 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.109857 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.110016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.110211 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.110368 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.110597 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.110770 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.110924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.111083 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.111236 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.111405 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.111585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.111823 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.111989 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.112148 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.112309 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.112478 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.112788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.112955 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.113116 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.113278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.113439 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.113598 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.113772 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.113940 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.114101 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.114295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.114471 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.114840 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.115004 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.115157 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.115317 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.115477 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.115637 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.115798 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.115973 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.116395 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.116669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.116837 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.116837 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.117138 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.117291 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.117450 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.117610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.117762 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.117912 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.118075 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.118227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.118421 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.119161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.119331 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.119501 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.119501 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.119811 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.119964 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.120125 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.120278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.120439 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.120593 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.120744 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.120900 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.121062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.121215 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.121633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.121805 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.122040 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.122200 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.122389 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.122546 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.122755 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.122913 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.123065 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.123216 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.123375 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.123553 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.123714 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.123866 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.124025 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.124194 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.124442 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.124615 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.124769 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.125038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.125197 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.125356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.125516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.125682 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.125847 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.126033 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.126397 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.126830 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.127006 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.127174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.127336 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.127490 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.127643 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.127794 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.127956 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.128108 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.128268 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.128431 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.128592 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.128751 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.128751 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.129057 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.129223 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.129385 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.129539 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.129698 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.129863 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.130016 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.130174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.130337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.130525 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.130702 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.130867 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.131027 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.131187 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.131187 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.131485 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.131648 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.131800 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.131951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.132187 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.132352 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.132352 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.132664 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.132823 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.132984 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.133143 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.133302 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.133454 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.133614 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.133767 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.133926 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.133926 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.134213 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.134373 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.134548 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.134738 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.134891 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.134891 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.135298 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.135472 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.135635 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.135788 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.135946 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.136116 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.136311 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.136620 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.136953 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.137130 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.137292 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.137597 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.137780 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.138023 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.138179 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.138330 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.138481 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.138688 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.138842 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.138842 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.139145 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.139308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.139467 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.139627 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.139789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.139943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.140102 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.140254 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.140412 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.140564 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.140729 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.140888 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.141050 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.141210 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.141372 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.141532 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.142267 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.142514 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.142790 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.142790 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.143095 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.143259 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.143259 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.143558 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.143558 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.143862 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.143862 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.144172 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.144326 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.144485 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.144644 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.144803 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.144803 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.145106 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.145282 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.145515 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.145515 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.145817 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.145979 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.146153 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.146321 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.146480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.146836 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.147211 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.147383 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.147548 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.147708 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.147869 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.148022 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.148175 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.148327 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.148489 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.148658 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.148819 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.148979 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.149133 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.149299 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.149455 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.149615 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.149775 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.149927 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.150088 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.150255 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.150418 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.150572 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.150816 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.150981 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.151143 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.151304 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.151466 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.151619 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.151771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.151932 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.152095 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.152247 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.152399 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.152665 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.152836 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.152998 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.153160 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.153319 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.153479 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.153641 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.153800 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.153966 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.154119 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.154270 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.154428 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.154597 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.154771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.154940 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.155099 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.155252 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.155404 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.155663 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.155839 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.156003 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.156158 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.156310 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.156470 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.156623 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.156913 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.157082 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.158206 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.158385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.158548 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.158548 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.159081 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.159242 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.159395 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.159395 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.159702 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.159871 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.160032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.160191 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.160344 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.160509 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.160662 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.160827 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.160983 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.161142 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.161295 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.161454 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.161614 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.161775 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.161928 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.162089 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.162242 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.162403 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.162684 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.162892 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.163058 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.163219 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.163380 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.163540 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.163706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.163859 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.164010 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.164170 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.164329 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.164481 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.164654 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.164815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.164967 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.165118 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.165270 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.165421 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.165582 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.165835 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.165995 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.166148 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.166320 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.166474 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.166661 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.166839 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.167086 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.167247 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.167416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.167587 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.167741 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.167900 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.168080 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.168413 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.168575 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.168744 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.168898 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.169050 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.169219 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.169372 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.169531 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.169702 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.169863 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.170016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.170176 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.170328 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.170495 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.170495 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.170813 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.170976 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.171138 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.171298 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.171461 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.171622 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.171782 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.171934 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.172085 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.172243 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.172409 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.172564 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.172723 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.172876 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.173967 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.174138 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.174302 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.174501 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.174763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.174931 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.175092 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.175261 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.175414 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.175574 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.175727 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.175987 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.176153 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.176317 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.176492 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.176654 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.176816 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.176969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.177228 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.177398 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.177552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.177712 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.177712 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.178010 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.178164 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.178350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.178525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.178716 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.178905 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.179067 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.179232 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.179393 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.179552 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.179705 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.179859 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.180010 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.180175 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.180330 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.180481 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.180648 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.180809 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.180971 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.181138 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.181290 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.181448 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.181606 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.181757 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.181922 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.182113 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.182267 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.182419 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.182643 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.182814 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.182985 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.183140 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.183297 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.183449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.183607 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.183767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.183934 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.184087 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.184246 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.184402 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.184552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.184767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.184938 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.185099 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.185258 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.185564 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.185738 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.185912 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.186174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.186174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.186479 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.186660 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.186819 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.186996 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.187168 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.187423 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.187583 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.187583 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.187884 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.188047 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.188200 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.188353 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.188531 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.189273 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.189555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.189806 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.190002 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.190160 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.190376 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.190550 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.190747 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.190903 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.191056 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.191215 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.191408 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.191563 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.191739 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.191892 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.191892 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.192219 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.192219 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.192219 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.192219 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.192966 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.193127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.193286 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.193446 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.193614 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.193770 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.193935 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.194119 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.194275 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.194436 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.194617 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.194776 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.194928 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.195127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.195281 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.195518 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.195675 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.195835 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.195987 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.196177 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.196419 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.196587 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.196749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.196903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.197069 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.197226 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.197405 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.197647 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.197807 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.197807 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.198111 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.198279 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.198451 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.198659 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.198869 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.199040 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.199193 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.199345 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.199505 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.199658 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.199826 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.199980 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.200132 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.200291 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.200467 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.200620 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.200771 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.200771 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.201079 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.201247 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.201401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.201554 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.201706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.201871 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.202024 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.202191 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.202351 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.202514 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.202704 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.202867 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.203028 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.203193 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.203347 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.203497 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.203649 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.203808 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.203968 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.204153 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.204314 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.204466 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.204635 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.204788 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.204955 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.205120 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.205280 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.205440 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.205593 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.205755 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.205923 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.206079 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.206079 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.206391 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.206691 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.206855 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.207023 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.207195 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.207349 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.207509 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.207689 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.207936 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.208107 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.208271 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.208426 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.208578 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.208729 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.208900 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.209063 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.209225 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.209385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.209547 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.209707 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.209870 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.210030 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.210183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.210342 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.210503 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.210713 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.210881 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.211097 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.211263 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.211418 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.211579 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.211732 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.211899 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.212052 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.212205 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.212358 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.212511 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.212672 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.212834 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.212834 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.213143 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.213303 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.213466 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.213629 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.213782 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.213935 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.214087 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.214240 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.214240 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.214547 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.214797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.214952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.215116 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.215268 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.215421 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.215591 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.215754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.215915 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.216069 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.216231 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.216395 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.216557 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.216862 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.217032 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.217199 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.217375 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.217543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.217706 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.217869 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.218173 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.218334 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.218487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.218677 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.218837 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.218991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.219143 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.219304 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.219465 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.219643 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.219829 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.219989 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.220152 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.220307 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.220473 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.220634 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.220798 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.220961 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.221113 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.221266 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.221428 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.221428 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.221750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.221904 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.222056 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.222215 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.222378 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.222378 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.222707 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.222707 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.223000 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.223173 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.223327 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.223480 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.223644 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.223644 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.223952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.224120 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.224281 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.224436 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.224587 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.224739 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.224891 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.225064 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.225218 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.225381 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.225548 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.225700 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.225859 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.226102 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.226102 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.226404 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.226566 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.226797 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.227121 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.227292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.227454 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.227609 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.227773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.227942 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.228110 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.228419 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.228579 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.228732 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.228884 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.229037 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.229200 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.229446 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.229607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.229607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.229907 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.230083 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.230238 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.230406 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.230406 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.230747 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.230902 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.231069 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.231069 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.231069 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.231518 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.231678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.231843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.232011 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.232183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.232347 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.232507 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.232662 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.232823 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.232984 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.233144 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.233304 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.233466 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.233621 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.233787 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.233940 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.234110 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.234265 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.234426 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.234631 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.234811 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.234966 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.235119 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.235271 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.235949 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.236129 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.236129 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.236450 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.236644 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.236830 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.236985 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.237292 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.237595 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.237785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.237942 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.238105 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.238266 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.238447 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.238748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.238922 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.239077 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.239245 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.239398 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.239564 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.239719 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.239870 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.240022 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.240175 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.240341 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.240502 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.240664 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.240818 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.240977 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.241138 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.241314 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.241469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.241620 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.241781 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.241945 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.242099 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.242261 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.242423 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.242600 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.242763 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.242926 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.243088 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.243298 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.243467 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.243628 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.243782 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.243935 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.244098 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.244251 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.244403 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.244562 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.244714 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.244873 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.245035 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.245189 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.245360 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.245521 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.245675 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.245675 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.245975 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.246130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.246552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.246811 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.246966 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.247128 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.247299 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.247584 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.247752 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.247920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.248073 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.248235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.248397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.248550 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.248722 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.249008 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.249168 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.249336 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.249491 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.249643 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.249794 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.249960 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.250123 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.250290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.250443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.250628 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.250789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.250942 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.251171 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.251846 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.252001 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.252160 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.252322 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.252475 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.252654 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.252847 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.253063 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.253231 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.253393 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.253546 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.253708 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.253861 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.254015 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.254166 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.254319 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.254481 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.254481 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.254867 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.255021 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.255181 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.255336 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.255505 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.255659 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.255819 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.255973 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.256134 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.256296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.256471 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.256626 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.256807 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.256969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.257122 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 08:24:49.257290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.257290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.257290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.257290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.257290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.257290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.257290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.257290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.258700 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.258700 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.258700 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.258700 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.258700 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.258700 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.258700 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.258700 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.260068 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.260068 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.260068 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.260068 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.260068 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.260068 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 08:24:49.260068 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 08:24:49.364642 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO dbcounter [None req-df0faa9b-e512-42a3-85ea-9462ea287d54 None None] Registered counter for database nova_api Jul 20 08:24:49.376659 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO dbcounter [None req-edc782f8-decc-4edf-af07-c7b94c4c6456 None None] Registered counter for database nova_api Jul 20 08:24:49.387975 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_db.sqlalchemy.engines [None req-df0faa9b-e512-42a3-85ea-9462ea287d54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117829) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 08:24:49.395597 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writer thread running {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 08:24:49.396762 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_db.sqlalchemy.engines [None req-edc782f8-decc-4edf-af07-c7b94c4c6456 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 08:24:49.403457 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writer thread running {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 08:24:49.455705 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.context [None req-df0faa9b-e512-42a3-85ea-9462ea287d54 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a041b14b-60ad-4ca6-8308-c42feb8d914c(cell1) {{(pid=117829) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 08:24:49.459759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-df0faa9b-e512-42a3-85ea-9462ea287d54 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:24:49.461375 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-df0faa9b-e512-42a3-85ea-9462ea287d54 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:24:49.461482 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.context [None req-edc782f8-decc-4edf-af07-c7b94c4c6456 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a041b14b-60ad-4ca6-8308-c42feb8d914c(cell1) {{(pid=117828) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 08:24:49.462192 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-df0faa9b-e512-42a3-85ea-9462ea287d54 None None] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:24:49.464226 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-df0faa9b-e512-42a3-85ea-9462ea287d54 None None] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:24:49.465483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-edc782f8-decc-4edf-af07-c7b94c4c6456 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:24:49.466245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO dbcounter [None req-df0faa9b-e512-42a3-85ea-9462ea287d54 None None] Registered counter for database nova_cell0 Jul 20 08:24:49.467112 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-edc782f8-decc-4edf-af07-c7b94c4c6456 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:24:49.467913 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-edc782f8-decc-4edf-af07-c7b94c4c6456 None None] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:24:49.471286 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-edc782f8-decc-4edf-af07-c7b94c4c6456 None None] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:24:49.471431 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO dbcounter [None req-df0faa9b-e512-42a3-85ea-9462ea287d54 None None] Registered counter for database nova_cell1 Jul 20 08:24:49.472665 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO dbcounter [None req-edc782f8-decc-4edf-af07-c7b94c4c6456 None None] Registered counter for database nova_cell0 Jul 20 08:24:49.476780 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO dbcounter [None req-edc782f8-decc-4edf-af07-c7b94c4c6456 None None] Registered counter for database nova_cell1 Jul 20 08:24:49.478998 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_db.sqlalchemy.engines [None req-df0faa9b-e512-42a3-85ea-9462ea287d54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117829) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 08:24:49.481296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_db.sqlalchemy.engines [None req-df0faa9b-e512-42a3-85ea-9462ea287d54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117829) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 08:24:49.486550 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_db.sqlalchemy.engines [None req-edc782f8-decc-4edf-af07-c7b94c4c6456 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 08:24:49.488401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_db.sqlalchemy.engines [None req-edc782f8-decc-4edf-af07-c7b94c4c6456 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 08:24:49.488774 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writer thread running {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 08:24:49.490849 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writer thread running {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 08:24:49.494109 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writer thread running {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 08:24:49.497012 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writer thread running {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 08:24:49.636858 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO dbcounter [None req-df0faa9b-e512-42a3-85ea-9462ea287d54 None None] Registered counter for database nova_cell0 Jul 20 08:24:49.645698 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_db.sqlalchemy.engines [None req-df0faa9b-e512-42a3-85ea-9462ea287d54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117829) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 08:24:49.646082 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO dbcounter [None req-edc782f8-decc-4edf-af07-c7b94c4c6456 None None] Registered counter for database nova_cell0 Jul 20 08:24:49.651097 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writer thread running {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 08:24:49.653113 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_db.sqlalchemy.engines [None req-edc782f8-decc-4edf-af07-c7b94c4c6456 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 08:24:49.658255 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writer thread running {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 08:24:49.973544 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: WARNING keystonemiddleware.auth_token [None req-df0faa9b-e512-42a3-85ea-9462ea287d54 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 08:24:49.979997 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: WARNING keystonemiddleware.auth_token [None req-edc782f8-decc-4edf-af07-c7b94c4c6456 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 08:24:49.980861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: WARNING keystonemiddleware.auth_token [None req-df0faa9b-e512-42a3-85ea-9462ea287d54 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 08:24:49.987341 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: WARNING keystonemiddleware.auth_token [None req-edc782f8-decc-4edf-af07-c7b94c4c6456 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 08:24:50.328898 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: WARNING keystonemiddleware.auth_token [None req-df0faa9b-e512-42a3-85ea-9462ea287d54 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 08:24:50.335011 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: WARNING keystonemiddleware.auth_token [None req-df0faa9b-e512-42a3-85ea-9462ea287d54 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 08:24:50.335746 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: WARNING keystonemiddleware.auth_token [None req-edc782f8-decc-4edf-af07-c7b94c4c6456 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 08:24:50.341247 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557ffd0109c0 pid: 117829 (default app) Jul 20 08:24:50.341789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: WARNING keystonemiddleware.auth_token [None req-edc782f8-decc-4edf-af07-c7b94c4c6456 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 08:24:50.348638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557ffd0109c0 pid: 117828 (default app) Jul 20 08:25:35.502917 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=3 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:25:35.505187 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=3 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:25:35.506405 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=3 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:25:35.513410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=3 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:25:36.235540 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=3 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:25:36.237193 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=3 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:25:36.239230 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=3 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:25:36.244331 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=3 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:25:37.736295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c5575896-4157-489a-926b-07e230d4565c tempest-VolumesGetTestJSON-1328868917 tempest-VolumesGetTestJSON-1328868917-project] Action: 'create', calling method: .version_select at 0x7fe39bd1cc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2077252785", "metadata": {"Type": "work"}}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:25:38.752631 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ada01f69-72d9-485e-a125-eccf7a694abc tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Action: 'create', calling method: .version_select at 0x7fe39bd1ac10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-253199920"}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:25:41.053642 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c5575896-4157-489a-926b-07e230d4565c tempest-VolumesGetTestJSON-1328868917 tempest-VolumesGetTestJSON-1328868917-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 5.596033 Jul 20 08:25:41.056294 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 1/1] 10.222.0.64 () {60 vars in 1155 bytes} [Wed Jul 20 08:25:35 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 5603 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 08:25:41.077433 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-63693339-132c-4ec8-8f24-a491b70614aa tempest-VolumesGetTestJSON-1328868917 tempest-VolumesGetTestJSON-1328868917-project] Calling method '.version_select at 0x7fe39bbe4a60>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:41.147150 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ada01f69-72d9-485e-a125-eccf7a694abc tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.915222 Jul 20 08:25:41.155987 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 1/2] 10.222.0.64 () {60 vars in 1154 bytes} [Wed Jul 20 08:25:36 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4934 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 08:25:41.162108 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-2cc84eeb-25f1-4176-9b50-2d95f1654377 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39bbdda60>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:41.226810 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-63693339-132c-4ec8-8f24-a491b70614aa tempest-VolumesGetTestJSON-1328868917 tempest-VolumesGetTestJSON-1328868917-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/70b332b1-e9d1-4aae-b852-64240bf8a7d9" status: 200 len: 353 microversion: 2.1 time: 0.160392 Jul 20 08:25:41.228181 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Jul 20 08:25:41 2022] GET /compute/v2.1/os-volumes/70b332b1-e9d1-4aae-b852-64240bf8a7d9 => generated 353 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:25:41.369036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-2cc84eeb-25f1-4176-9b50-2d95f1654377 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/cba62521-455e-4762-be54-95cca9d85e96" status: 200 len: 344 microversion: 2.1 time: 0.210982 Jul 20 08:25:41.370119 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Jul 20 08:25:41 2022] GET /compute/v2.1/os-volumes/cba62521-455e-4762-be54-95cca9d85e96 => generated 344 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:25:42.241885 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-26f7c24b-a198-4c7a-8eea-8322a622a2e1 tempest-VolumesGetTestJSON-1328868917 tempest-VolumesGetTestJSON-1328868917-project] Calling method '.version_select at 0x7fe39bbe4d30>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:42.392980 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-42519c44-a019-424b-b6d9-1b28429d24d7 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39bbddd30>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:42.507205 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-26f7c24b-a198-4c7a-8eea-8322a622a2e1 tempest-VolumesGetTestJSON-1328868917 tempest-VolumesGetTestJSON-1328868917-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/70b332b1-e9d1-4aae-b852-64240bf8a7d9" status: 200 len: 354 microversion: 2.1 time: 0.269130 Jul 20 08:25:42.517938 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 3/5] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Jul 20 08:25:42 2022] GET /compute/v2.1/os-volumes/70b332b1-e9d1-4aae-b852-64240bf8a7d9 => generated 354 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:25:42.520297 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-42519c44-a019-424b-b6d9-1b28429d24d7 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/cba62521-455e-4762-be54-95cca9d85e96" status: 200 len: 345 microversion: 2.1 time: 0.135769 Jul 20 08:25:42.526026 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-b4222282-bda4-4c15-8319-e1aef2049922 tempest-VolumesGetTestJSON-1328868917 tempest-VolumesGetTestJSON-1328868917-project] Calling method '.version_select at 0x7fe39bc001f0>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:42.532894 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 3/6] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Jul 20 08:25:42 2022] GET /compute/v2.1/os-volumes/cba62521-455e-4762-be54-95cca9d85e96 => generated 345 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:25:42.570418 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e16bb27e-5ab7-4742-8c21-b3fa171c79d3 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Action: 'create', calling method: .version_select at 0x7fe39bbfe160>, body: {"snapshot": {"volume_id": "cba62521-455e-4762-be54-95cca9d85e96", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1928530341"}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:25:42.648390 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-b4222282-bda4-4c15-8319-e1aef2049922 tempest-VolumesGetTestJSON-1328868917 tempest-VolumesGetTestJSON-1328868917-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/70b332b1-e9d1-4aae-b852-64240bf8a7d9" status: 200 len: 354 microversion: 2.1 time: 0.128428 Jul 20 08:25:42.649461 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Jul 20 08:25:42 2022] GET /compute/v2.1/os-volumes/70b332b1-e9d1-4aae-b852-64240bf8a7d9 => generated 354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:25:42.663686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-870d9000-bb3c-4f23-ba27-94bb454d8036 tempest-VolumesGetTestJSON-1328868917 tempest-VolumesGetTestJSON-1328868917-project] Calling method '.version_select at 0x7fe39bc00940>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:42.816661 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-870d9000-bb3c-4f23-ba27-94bb454d8036 tempest-VolumesGetTestJSON-1328868917 tempest-VolumesGetTestJSON-1328868917-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/70b332b1-e9d1-4aae-b852-64240bf8a7d9" status: 202 len: 0 microversion: 2.1 time: 0.157615 Jul 20 08:25:42.817796 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 5/8] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Jul 20 08:25:42 2022] DELETE /compute/v2.1/os-volumes/70b332b1-e9d1-4aae-b852-64240bf8a7d9 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 08:25:42.826308 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-19d5c690-5741-445f-b7fe-c668554a7faf tempest-VolumesGetTestJSON-1328868917 tempest-VolumesGetTestJSON-1328868917-project] Calling method '.version_select at 0x7fe39bbe4ca0>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:42.975413 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-19d5c690-5741-445f-b7fe-c668554a7faf tempest-VolumesGetTestJSON-1328868917 tempest-VolumesGetTestJSON-1328868917-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/70b332b1-e9d1-4aae-b852-64240bf8a7d9" status: 200 len: 353 microversion: 2.1 time: 0.152926 Jul 20 08:25:42.976564 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 6/9] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Jul 20 08:25:42 2022] GET /compute/v2.1/os-volumes/70b332b1-e9d1-4aae-b852-64240bf8a7d9 => generated 353 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:25:43.130809 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e16bb27e-5ab7-4742-8c21-b3fa171c79d3 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.595546 Jul 20 08:25:43.147154 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 4/10] 10.222.0.64 () {60 vars in 1161 bytes} [Wed Jul 20 08:25:42 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:25:43.150016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c745192a-a7c4-465a-9c3a-2080cbeb92f4 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39bc00c10>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:43.488372 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c745192a-a7c4-465a-9c3a-2080cbeb92f4 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0" status: 200 len: 287 microversion: 2.1 time: 0.345572 Jul 20 08:25:43.513232 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 7/11] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Jul 20 08:25:43 2022] GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0 => generated 287 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:25:43.519842 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-11997745-d31b-4dca-b9d0-d484abd80ea4 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39bbfed30>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:43.648882 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-11997745-d31b-4dca-b9d0-d484abd80ea4 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.141579 Jul 20 08:25:43.669566 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 5/12] 10.222.0.64 () {58 vars in 1139 bytes} [Wed Jul 20 08:25:43 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:25:43.676283 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-31b1a391-fddd-4bc4-bcdb-7401ebe5474d tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39bc00430>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:43.718885 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-31b1a391-fddd-4bc4-bcdb-7401ebe5474d tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0" status: 200 len: 287 microversion: 2.1 time: 0.054288 Jul 20 08:25:43.725804 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 8/13] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Jul 20 08:25:43 2022] GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0 => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:25:44.012212 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e6ec84a1-e32c-4e60-8c3b-9565fa5a5507 tempest-VolumesGetTestJSON-1328868917 tempest-VolumesGetTestJSON-1328868917-project] Calling method '.version_select at 0x7fe39bbfeb80>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:44.207885 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-e6ec84a1-e32c-4e60-8c3b-9565fa5a5507 tempest-VolumesGetTestJSON-1328868917 tempest-VolumesGetTestJSON-1328868917-project] HTTP exception thrown: Volume 70b332b1-e9d1-4aae-b852-64240bf8a7d9 could not be found. Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e6ec84a1-e32c-4e60-8c3b-9565fa5a5507 tempest-VolumesGetTestJSON-1328868917 tempest-VolumesGetTestJSON-1328868917-project] Request method failure captured: Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/os-volumes/70b332b1-e9d1-4aae-b852-64240bf8a7d9 HTTP/1.1 Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17v_35Z3BsRGf0zBSak-D07yHqhLXaeM5X0od5HQO5nrIaCkMndEtjOwQ76wG_h1_KWK_d51yLdo6K6ZRZhlDokCw9acDSdZ9Ko_9Ade89qa1Hz4JKDn0GdCPNxSkOledvs3B8gttdD28eyOIze1oSd3snUfsahuYiyrFg5LkCl0bF0 Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: 375f46c4a1864eda97310c66a5239184 Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-VolumesGetTestJSON-1328868917 Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:25:44.220795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:25:44.221969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/375f46c4a1864eda97310c66a5239184"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/375f46c4a1864eda97310c66a5239184"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_375f46c4a1864eda97310c66a5239184", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/375f46c4a1864eda97310c66a5239184"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:25:44.221969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-VolumesGetTestJSON-1328868917 Jul 20 08:25:44.221969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: 375f46c4a1864eda97310c66a5239184 Jul 20 08:25:44.221969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-VolumesGetTestJSON-1328868917 Jul 20 08:25:44.221969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-VolumesGetTestJSON-1328868917-project Jul 20 08:25:44.221969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:25:44.221969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:25:44.221969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: 60794cf8fe974f239f79eee67509f205 Jul 20 08:25:44.221969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-VolumesGetTestJSON-1328868917-project Jul 20 08:25:44.221969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: Jul 20 08:25:44.221969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Volume 70b332b1-e9d1-4aae-b852-64240bf8a7d9 could not be found. Jul 20 08:25:44.221969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': '70b332b1-e9d1-4aae-b852-64240bf8a7d9'} Jul 20 08:25:44.221969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:25:44.222764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:44.222764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 08:25:44.222764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 08:25:44.222764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 08:25:44.222764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 08:25:44.222764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 08:25:44.222764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 08:25:44.222764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 08:25:44.222764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 08:25:44.222764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 08:25:44.222764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 08:25:44.222764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 08:25:44.222764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 08:25:44.222764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 08:25:44.222764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 08:25:44.222764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 70b332b1-e9d1-4aae-b852-64240bf8a7d9 could not be found. (HTTP 404) (Request-ID: req-5e863124-a54d-46ab-b56a-48f237c7af11) Jul 20 08:25:44.222764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:44.222764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:44.222764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:44.224182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:44.224182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 08:25:44.224182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 08:25:44.224182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 08:25:44.224182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 08:25:44.224182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 08:25:44.224182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 08:25:44.224182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 08:25:44.224182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 08:25:44.224182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 08:25:44.224182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 08:25:44.224182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 08:25:44.224182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 08:25:44.224182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 08:25:44.224182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 08:25:44.224182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 08:25:44.224182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 08:25:44.224182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 08:25:44.224182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 08:25:44.225032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 08:25:44.225032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 08:25:44.225032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 08:25:44.225032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 08:25:44.225032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 70b332b1-e9d1-4aae-b852-64240bf8a7d9 could not be found. Jul 20 08:25:44.225032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:44.225032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:44.225032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:44.225032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:44.225032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:44.225032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:44.225032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:25:44.225032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:25:44.225032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 08:25:44.225032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 08:25:44.225032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:25:44.225032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:25:44.225032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 08:25:44.225032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:25:44.225919 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 70b332b1-e9d1-4aae-b852-64240bf8a7d9 could not be found. Jul 20 08:25:44.225919 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:44.225919 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:44.225919 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:44.225919 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:44.225919 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:44.225919 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:44.225919 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:25:44.225919 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:25:44.225919 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 70b332b1-e9d1-4aae-b852-64240bf8a7d9 could not be found. Jul 20 08:25:44.225919 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:44.227899 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e6ec84a1-e32c-4e60-8c3b-9565fa5a5507 tempest-VolumesGetTestJSON-1328868917 tempest-VolumesGetTestJSON-1328868917-project] Returning 404 to user: Volume 70b332b1-e9d1-4aae-b852-64240bf8a7d9 could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:25:44.230842 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e6ec84a1-e32c-4e60-8c3b-9565fa5a5507 tempest-VolumesGetTestJSON-1328868917 tempest-VolumesGetTestJSON-1328868917-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/70b332b1-e9d1-4aae-b852-64240bf8a7d9" status: 404 len: 109 microversion: 2.1 time: 0.245121 Jul 20 08:25:44.237883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 6/14] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Jul 20 08:25:43 2022] GET /compute/v2.1/os-volumes/70b332b1-e9d1-4aae-b852-64240bf8a7d9 => generated 109 bytes in 253 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:25:44.734091 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5147d64b-fcfa-402f-98c8-d0c951771cf1 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39bbe4c10>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:44.823882 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5147d64b-fcfa-402f-98c8-d0c951771cf1 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0" status: 200 len: 287 microversion: 2.1 time: 0.093694 Jul 20 08:25:44.827107 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 9/15] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Jul 20 08:25:44 2022] GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0 => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:25:45.839925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-86d494ef-8416-43f8-bad0-f46764cfed9d tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39bbfef70>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:45.913225 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-86d494ef-8416-43f8-bad0-f46764cfed9d tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0" status: 200 len: 287 microversion: 2.1 time: 0.077873 Jul 20 08:25:45.914005 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 7/16] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Jul 20 08:25:45 2022] GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:25:46.940914 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-631434fa-b2d2-4099-b200-a78ed4c32bca tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39bc000d0>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:47.038683 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-631434fa-b2d2-4099-b200-a78ed4c32bca tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0" status: 200 len: 287 microversion: 2.1 time: 0.104860 Jul 20 08:25:47.047829 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 10/17] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Jul 20 08:25:46 2022] GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0 => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:25:48.068938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b61b7b45-94fb-4a01-bc09-14581552fe1d tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39bb554c0>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:48.196864 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b61b7b45-94fb-4a01-bc09-14581552fe1d tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0" status: 200 len: 287 microversion: 2.1 time: 0.143275 Jul 20 08:25:48.197951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 8/18] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Jul 20 08:25:48 2022] GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0 => generated 287 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:25:49.051498 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-571841f8-5fc2-4f82-a0a6-022468d4eb97 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1991612691", "imageRef": "5d6b971e-8afe-4e4a-b054-20cd61970c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:25:49.325359 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.network.neutron [None req-571841f8-5fc2-4f82-a0a6-022468d4eb97 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] validate_networks() for [('c96fa3a3-1d61-4869-813f-bb65cb182cb7', None, None, None, None, None)] {{(pid=117829) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:25:49.393785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d0abb813-6fbc-4289-b8bd-3bab7b37a9f9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Action: 'create', calling method: .version_select at 0x7fe39bb558b0>, body: {"keypair": {"name": "tempest-keypair-972139346", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3mAwEGXqMahGtVx/F3WBmiPuhQM173r0XVmBAS9FvSf60ncRNjD1JKAEJ5M5Po9mlOASMVzfDiGfHwuyVsoApzLjhIVyZb+hCZqPKompVCoGaf35VFacFtjJ9/vw+cCg=="}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:25:49.623802 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-d0abb813-6fbc-4289-b8bd-3bab7b37a9f9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Getting quotas for project 80faf6362e244bb992ffb6058ceeefda. Resources: {'key_pairs'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:25:49.674822 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-d0abb813-6fbc-4289-b8bd-3bab7b37a9f9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Getting quotas for user fb5f0f7e59dd4c548a6ea72bb25f1ebb and project 80faf6362e244bb992ffb6058ceeefda. Resources: {'key_pairs'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:25:49.909069 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d0abb813-6fbc-4289-b8bd-3bab7b37a9f9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.762447 Jul 20 08:25:49.912106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 9/19] 10.222.0.64 () {62 vars in 1199 bytes} [Wed Jul 20 08:25:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 767 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 08:25:49.922842 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-931b5596-d0df-44f5-a3c6-6f392f5c8b45 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39b2e7280>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:50.038033 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-931b5596-d0df-44f5-a3c6-6f392f5c8b45 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0" status: 200 len: 288 microversion: 2.1 time: 0.123602 Jul 20 08:25:50.039152 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 10/20] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Jul 20 08:25:49 2022] GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0 => generated 288 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:25:50.057911 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0f5548eb-15dc-4d73-a14e-e8f7e15c05f6 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39bb38820>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:50.298141 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0f5548eb-15dc-4d73-a14e-e8f7e15c05f6 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0" status: 202 len: 0 microversion: 2.1 time: 0.250518 Jul 20 08:25:50.302285 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 11/21] 10.222.0.64 () {58 vars in 1253 bytes} [Wed Jul 20 08:25:50 2022] DELETE /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:25:50.334140 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b4bb04f5-07a8-4461-b87f-beb99d6a0c0c tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39b2e70d0>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:50.447435 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b4bb04f5-07a8-4461-b87f-beb99d6a0c0c tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0" status: 200 len: 287 microversion: 2.1 time: 0.139624 Jul 20 08:25:50.454711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 12/22] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Jul 20 08:25:50 2022] GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0 => generated 287 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:25:51.116796 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b639859b-30ae-4e26-be5c-a45447ad1527 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] Action: 'create', calling method: .version_select at 0x7fe39b2e7af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-500296152", "metadata": {"Type": "work"}}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b639859b-30ae-4e26-be5c-a45447ad1527 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] Request method failure captured: Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 121 Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wOaylq7MNevUcrSEK-D7PifP7ybNfcVY8zbwTDDNjQ7JHKtz9U-S4cxnvkuxvMVMfalFsSZ_oz4kgTYJawrjxBnJurC6cqNzDIbZOIeMZ7zwCfC-QVrc_vZTpdok6ZRghrxZCmlzhiEUSCRKRMbLvDAvmMJ7A3HiroENWZ13Y1kDY Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: a683127be5754f4e9b144a505638eeaf Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-VolumesNegativeTest-507343391 Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:25:51.128249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:25:51.129554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a683127be5754f4e9b144a505638eeaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a683127be5754f4e9b144a505638eeaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a683127be5754f4e9b144a505638eeaf", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a683127be5754f4e9b144a505638eeaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:25:51.129554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-VolumesNegativeTest-507343391 Jul 20 08:25:51.129554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: a683127be5754f4e9b144a505638eeaf Jul 20 08:25:51.129554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-VolumesNegativeTest-507343391 Jul 20 08:25:51.129554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-VolumesNegativeTest-507343391-project Jul 20 08:25:51.129554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:25:51.129554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:25:51.129554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: c4e062536b544daf9fa869bff6eb28ba Jul 20 08:25:51.129554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-VolumesNegativeTest-507343391-project Jul 20 08:25:51.129554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Jul 20 08:25:51.129554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-500296152", "metadata": {"Type": "work"}}} Jul 20 08:25:51.129554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: Jul 20 08:25:51.129554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-500296152', 'metadata': {'Type': 'work'}}}} Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise error Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi '#$%' Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:25:51.130349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:25:51.131827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 08:25:51.131827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 08:25:51.131827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:25:51.131827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:25:51.131827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 08:25:51.131827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 08:25:51.131827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 08:25:51.131827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 08:25:51.131827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 08:25:51.131827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 08:25:51.131827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 08:25:51.131827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.131827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:51.131827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.131827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.131827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:51.131827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:51.131827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 08:25:51.131827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 08:25:51.132884 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 08:25:51.132884 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.133941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b639859b-30ae-4e26-be5c-a45447ad1527 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:25:51.135197 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b639859b-30ae-4e26-be5c-a45447ad1527 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.410130 Jul 20 08:25:51.137910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 13/23] 10.222.0.64 () {60 vars in 1155 bytes} [Wed Jul 20 08:25:50 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 413 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 08:25:51.148641 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1ba68c93-f50a-4b0e-81fb-4428425f2e45 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] Action: 'create', calling method: .version_select at 0x7fe39bb7e700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1336686403", "metadata": {"Type": "work"}}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1ba68c93-f50a-4b0e-81fb-4428425f2e45 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] Request method failure captured: Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 120 Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wOaylq7MNevUcrSEK-D7PifP7ybNfcVY8zbwTDDNjQ7JHKtz9U-S4cxnvkuxvMVMfalFsSZ_oz4kgTYJawrjxBnJurC6cqNzDIbZOIeMZ7zwCfC-QVrc_vZTpdok6ZRghrxZCmlzhiEUSCRKRMbLvDAvmMJ7A3HiroENWZ13Y1kDY Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: a683127be5754f4e9b144a505638eeaf Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-VolumesNegativeTest-507343391 Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:25:51.152441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:25:51.153585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a683127be5754f4e9b144a505638eeaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a683127be5754f4e9b144a505638eeaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a683127be5754f4e9b144a505638eeaf", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a683127be5754f4e9b144a505638eeaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:25:51.153585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-VolumesNegativeTest-507343391 Jul 20 08:25:51.153585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: a683127be5754f4e9b144a505638eeaf Jul 20 08:25:51.153585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-VolumesNegativeTest-507343391 Jul 20 08:25:51.153585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-VolumesNegativeTest-507343391-project Jul 20 08:25:51.153585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:25:51.153585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:25:51.153585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: c4e062536b544daf9fa869bff6eb28ba Jul 20 08:25:51.153585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-VolumesNegativeTest-507343391-project Jul 20 08:25:51.153585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Jul 20 08:25:51.153585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1336686403", "metadata": {"Type": "work"}}} Jul 20 08:25:51.153585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: Jul 20 08:25:51.153585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1336686403', 'metadata': {'Type': 'work'}}}} Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise error Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi '0' Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:25:51.154290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:25:51.155638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 08:25:51.155638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 08:25:51.155638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:25:51.155638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:25:51.155638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 08:25:51.155638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 08:25:51.155638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 08:25:51.155638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 08:25:51.155638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 08:25:51.155638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 08:25:51.155638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 08:25:51.155638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.155638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:51.155638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.155638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.155638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:51.155638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:51.155638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 08:25:51.155638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 08:25:51.156635 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 08:25:51.156635 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.161980 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1ba68c93-f50a-4b0e-81fb-4428425f2e45 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:25:51.163061 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1ba68c93-f50a-4b0e-81fb-4428425f2e45 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018619 Jul 20 08:25:51.164127 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 14/24] 10.222.0.64 () {60 vars in 1155 bytes} [Wed Jul 20 08:25:51 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 08:25:51.177679 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5de3d54e-8259-4673-b373-f227ae806906 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] Action: 'create', calling method: .version_select at 0x7fe39b2f9a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1892423101", "metadata": {"Type": "work"}}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5de3d54e-8259-4673-b373-f227ae806906 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] Request method failure captured: Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 119 Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wOaylq7MNevUcrSEK-D7PifP7ybNfcVY8zbwTDDNjQ7JHKtz9U-S4cxnvkuxvMVMfalFsSZ_oz4kgTYJawrjxBnJurC6cqNzDIbZOIeMZ7zwCfC-QVrc_vZTpdok6ZRghrxZCmlzhiEUSCRKRMbLvDAvmMJ7A3HiroENWZ13Y1kDY Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: a683127be5754f4e9b144a505638eeaf Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-VolumesNegativeTest-507343391 Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:25:51.180838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:25:51.182041 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a683127be5754f4e9b144a505638eeaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a683127be5754f4e9b144a505638eeaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a683127be5754f4e9b144a505638eeaf", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a683127be5754f4e9b144a505638eeaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:25:51.182041 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-VolumesNegativeTest-507343391 Jul 20 08:25:51.182041 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: a683127be5754f4e9b144a505638eeaf Jul 20 08:25:51.182041 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-VolumesNegativeTest-507343391 Jul 20 08:25:51.182041 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-VolumesNegativeTest-507343391-project Jul 20 08:25:51.182041 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:25:51.182041 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:25:51.182041 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: c4e062536b544daf9fa869bff6eb28ba Jul 20 08:25:51.182041 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-VolumesNegativeTest-507343391-project Jul 20 08:25:51.182041 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Jul 20 08:25:51.182041 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1892423101", "metadata": {"Type": "work"}}} Jul 20 08:25:51.182041 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: Jul 20 08:25:51.182041 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1892423101', 'metadata': {'Type': 'work'}}}} Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise error Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi '' Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:25:51.182804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:25:51.183951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 08:25:51.183951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 08:25:51.183951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:25:51.183951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:25:51.183951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 08:25:51.183951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 08:25:51.183951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 08:25:51.183951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 08:25:51.183951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 08:25:51.183951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 08:25:51.183951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 08:25:51.183951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.183951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:51.183951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.183951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.183951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:51.183951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:51.183951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 08:25:51.183951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 08:25:51.184814 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 08:25:51.184814 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.195536 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5de3d54e-8259-4673-b373-f227ae806906 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:25:51.196759 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-5de3d54e-8259-4673-b373-f227ae806906 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024958 Jul 20 08:25:51.197897 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 15/25] 10.222.0.64 () {60 vars in 1155 bytes} [Wed Jul 20 08:25:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 08:25:51.210097 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-092c0ca1-a3e3-451f-aa92-c9830c32f673 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] Calling method '.version_select at 0x7fe39bb389d0>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:51.255556 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-092c0ca1-a3e3-451f-aa92-c9830c32f673 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] HTTP exception thrown: Volume tempest-invalid-1543496290 could not be found. Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-092c0ca1-a3e3-451f-aa92-c9830c32f673 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] Request method failure captured: Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1543496290 HTTP/1.1 Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wOaylq7MNevUcrSEK-D7PifP7ybNfcVY8zbwTDDNjQ7JHKtz9U-S4cxnvkuxvMVMfalFsSZ_oz4kgTYJawrjxBnJurC6cqNzDIbZOIeMZ7zwCfC-QVrc_vZTpdok6ZRghrxZCmlzhiEUSCRKRMbLvDAvmMJ7A3HiroENWZ13Y1kDY Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: a683127be5754f4e9b144a505638eeaf Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-VolumesNegativeTest-507343391 Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:25:51.258022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:25:51.259235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a683127be5754f4e9b144a505638eeaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a683127be5754f4e9b144a505638eeaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a683127be5754f4e9b144a505638eeaf", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a683127be5754f4e9b144a505638eeaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:25:51.259235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-VolumesNegativeTest-507343391 Jul 20 08:25:51.259235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: a683127be5754f4e9b144a505638eeaf Jul 20 08:25:51.259235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-VolumesNegativeTest-507343391 Jul 20 08:25:51.259235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-VolumesNegativeTest-507343391-project Jul 20 08:25:51.259235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:25:51.259235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:25:51.259235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: c4e062536b544daf9fa869bff6eb28ba Jul 20 08:25:51.259235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-VolumesNegativeTest-507343391-project Jul 20 08:25:51.259235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: Jul 20 08:25:51.259235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Volume tempest-invalid-1543496290 could not be found. Jul 20 08:25:51.259235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': 'tempest-invalid-1543496290'} Jul 20 08:25:51.259235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:25:51.260062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.260062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 08:25:51.260062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 08:25:51.260062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 08:25:51.260062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 08:25:51.260062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 08:25:51.260062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 08:25:51.260062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 08:25:51.260062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 08:25:51.260062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 08:25:51.260062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 08:25:51.260062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 08:25:51.260062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 08:25:51.260062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 08:25:51.260062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 08:25:51.260062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1543496290 could not be found. (HTTP 404) (Request-ID: req-888a3f2c-383d-4f51-a621-b7276aee9b9d) Jul 20 08:25:51.260062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.260062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:51.260062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.261106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.261106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 08:25:51.261106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 08:25:51.261106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 08:25:51.261106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 08:25:51.261106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 08:25:51.261106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 08:25:51.261106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 08:25:51.261106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 08:25:51.261106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 08:25:51.261106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 08:25:51.261106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 08:25:51.261106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 08:25:51.261106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 08:25:51.261106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 08:25:51.261106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 08:25:51.261106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 08:25:51.261106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 08:25:51.261106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 08:25:51.261991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 08:25:51.261991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 08:25:51.261991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 08:25:51.261991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 08:25:51.261991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1543496290 could not be found. Jul 20 08:25:51.261991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.261991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:51.261991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.261991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.261991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:51.261991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:51.261991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:25:51.261991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:25:51.261991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 08:25:51.261991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 08:25:51.261991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:25:51.261991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:25:51.261991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 08:25:51.261991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:25:51.261991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1543496290 could not be found. Jul 20 08:25:51.262938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.262938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:51.262938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.262938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.262938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:51.262938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:51.262938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:25:51.262938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:25:51.262938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1543496290 could not be found. Jul 20 08:25:51.262938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.265001 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-092c0ca1-a3e3-451f-aa92-c9830c32f673 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] Returning 404 to user: Volume tempest-invalid-1543496290 could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:25:51.267065 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-092c0ca1-a3e3-451f-aa92-c9830c32f673 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1543496290" status: 404 len: 99 microversion: 2.1 time: 0.059995 Jul 20 08:25:51.268114 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 16/26] 10.222.0.64 () {58 vars in 1217 bytes} [Wed Jul 20 08:25:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1543496290 => generated 99 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 20 08:25:51.287034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ccc9ba7a-e14e-449b-a16d-d92560393668 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007542 Jul 20 08:25:51.287911 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 17/27] 10.222.0.64 () {58 vars in 1139 bytes} [Wed Jul 20 08:25:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 20 08:25:51.308975 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-cdbd6b9c-5759-466c-9d45-14802cd105e9 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009668 Jul 20 08:25:51.310475 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 18/28] 10.222.0.64 () {58 vars in 1136 bytes} [Wed Jul 20 08:25:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 08:25:51.332686 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-acf8a882-4249-4c02-8987-6fe9f593a3dc tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] Calling method '.version_select at 0x7fe39b2f9820>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:51.405551 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-acf8a882-4249-4c02-8987-6fe9f593a3dc tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] HTTP exception thrown: Volume 3a90df57-e3b5-4550-8a30-4acf9e77cc95 could not be found. Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-acf8a882-4249-4c02-8987-6fe9f593a3dc tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] Request method failure captured: Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: DELETE /compute/v2.1/os-volumes/3a90df57-e3b5-4550-8a30-4acf9e77cc95 HTTP/1.1 Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wOaylq7MNevUcrSEK-D7PifP7ybNfcVY8zbwTDDNjQ7JHKtz9U-S4cxnvkuxvMVMfalFsSZ_oz4kgTYJawrjxBnJurC6cqNzDIbZOIeMZ7zwCfC-QVrc_vZTpdok6ZRghrxZCmlzhiEUSCRKRMbLvDAvmMJ7A3HiroENWZ13Y1kDY Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: a683127be5754f4e9b144a505638eeaf Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-VolumesNegativeTest-507343391 Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:25:51.408943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:25:51.410043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a683127be5754f4e9b144a505638eeaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a683127be5754f4e9b144a505638eeaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a683127be5754f4e9b144a505638eeaf", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a683127be5754f4e9b144a505638eeaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:25:51.410043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-VolumesNegativeTest-507343391 Jul 20 08:25:51.410043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: a683127be5754f4e9b144a505638eeaf Jul 20 08:25:51.410043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-VolumesNegativeTest-507343391 Jul 20 08:25:51.410043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-VolumesNegativeTest-507343391-project Jul 20 08:25:51.410043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:25:51.410043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:25:51.410043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: c4e062536b544daf9fa869bff6eb28ba Jul 20 08:25:51.410043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-VolumesNegativeTest-507343391-project Jul 20 08:25:51.410043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: Jul 20 08:25:51.410043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Volume 3a90df57-e3b5-4550-8a30-4acf9e77cc95 could not be found. Jul 20 08:25:51.410043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': '3a90df57-e3b5-4550-8a30-4acf9e77cc95'} Jul 20 08:25:51.410043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:25:51.410718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.410718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 08:25:51.410718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 08:25:51.410718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 08:25:51.410718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 08:25:51.410718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 08:25:51.410718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 08:25:51.410718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 08:25:51.410718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 08:25:51.410718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 08:25:51.410718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 08:25:51.410718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 08:25:51.410718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 08:25:51.410718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 08:25:51.410718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 08:25:51.410718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a90df57-e3b5-4550-8a30-4acf9e77cc95 could not be found. (HTTP 404) (Request-ID: req-43f71dd7-5635-426d-9c7e-c10b1d1426d7) Jul 20 08:25:51.410718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.410718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:51.410718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.411615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.411615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 08:25:51.411615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 08:25:51.411615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 08:25:51.411615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 08:25:51.411615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 08:25:51.411615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 08:25:51.411615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 08:25:51.411615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 08:25:51.411615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 08:25:51.411615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 08:25:51.411615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 08:25:51.411615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 08:25:51.411615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 08:25:51.411615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 08:25:51.411615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 08:25:51.411615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 08:25:51.411615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 08:25:51.411615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 08:25:51.412801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 08:25:51.412801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 08:25:51.412801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 08:25:51.412801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 08:25:51.412801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a90df57-e3b5-4550-8a30-4acf9e77cc95 could not be found. Jul 20 08:25:51.412801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.412801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:51.412801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.412801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.412801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:51.412801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:51.412801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:25:51.412801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:25:51.412801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 08:25:51.412801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 08:25:51.412801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:25:51.412801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:25:51.412801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 08:25:51.412801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:25:51.416347 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a90df57-e3b5-4550-8a30-4acf9e77cc95 could not be found. Jul 20 08:25:51.416347 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.416347 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:51.416347 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.416347 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.416347 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:51.416347 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:51.416347 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:25:51.416347 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:25:51.416347 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a90df57-e3b5-4550-8a30-4acf9e77cc95 could not be found. Jul 20 08:25:51.416347 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.418759 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-acf8a882-4249-4c02-8987-6fe9f593a3dc tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] Returning 404 to user: Volume 3a90df57-e3b5-4550-8a30-4acf9e77cc95 could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:25:51.419842 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-acf8a882-4249-4c02-8987-6fe9f593a3dc tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/3a90df57-e3b5-4550-8a30-4acf9e77cc95" status: 404 len: 109 microversion: 2.1 time: 0.099285 Jul 20 08:25:51.421370 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 19/29] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Jul 20 08:25:51 2022] DELETE /compute/v2.1/os-volumes/3a90df57-e3b5-4550-8a30-4acf9e77cc95 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:25:51.433853 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-72f14005-ed07-435a-9df4-3abfa284a3a1 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] Calling method '.version_select at 0x7fe39b29e5e0>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:51.483701 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-72f14005-ed07-435a-9df4-3abfa284a3a1 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] HTTP exception thrown: Volume d4907376-ee32-4d46-84b8-04b8c169d410 could not be found. Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-72f14005-ed07-435a-9df4-3abfa284a3a1 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] Request method failure captured: Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/os-volumes/d4907376-ee32-4d46-84b8-04b8c169d410 HTTP/1.1 Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wOaylq7MNevUcrSEK-D7PifP7ybNfcVY8zbwTDDNjQ7JHKtz9U-S4cxnvkuxvMVMfalFsSZ_oz4kgTYJawrjxBnJurC6cqNzDIbZOIeMZ7zwCfC-QVrc_vZTpdok6ZRghrxZCmlzhiEUSCRKRMbLvDAvmMJ7A3HiroENWZ13Y1kDY Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: a683127be5754f4e9b144a505638eeaf Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-VolumesNegativeTest-507343391 Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:25:51.488106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:25:51.489191 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a683127be5754f4e9b144a505638eeaf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a683127be5754f4e9b144a505638eeaf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a683127be5754f4e9b144a505638eeaf", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a683127be5754f4e9b144a505638eeaf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:25:51.489191 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-VolumesNegativeTest-507343391 Jul 20 08:25:51.489191 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: a683127be5754f4e9b144a505638eeaf Jul 20 08:25:51.489191 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-VolumesNegativeTest-507343391 Jul 20 08:25:51.489191 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-VolumesNegativeTest-507343391-project Jul 20 08:25:51.489191 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:25:51.489191 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:25:51.489191 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: c4e062536b544daf9fa869bff6eb28ba Jul 20 08:25:51.489191 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-VolumesNegativeTest-507343391-project Jul 20 08:25:51.489191 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: Jul 20 08:25:51.489191 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Volume d4907376-ee32-4d46-84b8-04b8c169d410 could not be found. Jul 20 08:25:51.489191 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': 'd4907376-ee32-4d46-84b8-04b8c169d410'} Jul 20 08:25:51.489191 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:25:51.489852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.489852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 08:25:51.489852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 08:25:51.489852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 08:25:51.489852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 08:25:51.489852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 08:25:51.489852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 08:25:51.489852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 08:25:51.489852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 08:25:51.489852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 08:25:51.489852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 08:25:51.489852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 08:25:51.489852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 08:25:51.489852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 08:25:51.489852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 08:25:51.489852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d4907376-ee32-4d46-84b8-04b8c169d410 could not be found. (HTTP 404) (Request-ID: req-99757f82-7927-4c98-87ea-a65dfc80c961) Jul 20 08:25:51.489852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.489852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:51.489852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.490750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.490750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 08:25:51.490750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 08:25:51.490750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 08:25:51.490750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 08:25:51.490750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 08:25:51.490750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 08:25:51.490750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 08:25:51.490750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 08:25:51.490750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 08:25:51.490750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 08:25:51.490750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 08:25:51.490750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 08:25:51.490750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 08:25:51.490750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 08:25:51.490750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 08:25:51.490750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 08:25:51.490750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 08:25:51.490750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 08:25:51.491610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 08:25:51.491610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 08:25:51.491610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 08:25:51.491610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 08:25:51.491610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d4907376-ee32-4d46-84b8-04b8c169d410 could not be found. Jul 20 08:25:51.491610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.491610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:51.491610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.491610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.491610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:51.491610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:51.491610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:25:51.491610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:25:51.491610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 08:25:51.491610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 08:25:51.491610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:25:51.491610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:25:51.491610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 08:25:51.491610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:25:51.492474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d4907376-ee32-4d46-84b8-04b8c169d410 could not be found. Jul 20 08:25:51.492474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.492474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:51.492474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.492474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:51.492474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:51.492474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:51.492474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:25:51.492474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:25:51.492474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d4907376-ee32-4d46-84b8-04b8c169d410 could not be found. Jul 20 08:25:51.492474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:51.494726 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-72f14005-ed07-435a-9df4-3abfa284a3a1 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] Returning 404 to user: Volume d4907376-ee32-4d46-84b8-04b8c169d410 could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:25:51.496250 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-72f14005-ed07-435a-9df4-3abfa284a3a1 tempest-VolumesNegativeTest-507343391 tempest-VolumesNegativeTest-507343391-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/d4907376-ee32-4d46-84b8-04b8c169d410" status: 404 len: 109 microversion: 2.1 time: 0.066547 Jul 20 08:25:51.497938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 20/30] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Jul 20 08:25:51 2022] GET /compute/v2.1/os-volumes/d4907376-ee32-4d46-84b8-04b8c169d410 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:25:51.518472 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-90b128d2-5fa8-4846-8f44-09277f501885 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39b2e7550>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:51.569966 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-90b128d2-5fa8-4846-8f44-09277f501885 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0" status: 200 len: 287 microversion: 2.1 time: 0.068783 Jul 20 08:25:51.570868 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 21/31] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Jul 20 08:25:51 2022] GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:25:51.867151 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-571841f8-5fc2-4f82-a0a6-022468d4eb97 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Flavor limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:25:51.867715 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-571841f8-5fc2-4f82-a0a6-022468d4eb97 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Image limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:25:51.868051 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-571841f8-5fc2-4f82-a0a6-022468d4eb97 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Flavor pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:25:51.868471 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-571841f8-5fc2-4f82-a0a6-022468d4eb97 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Image pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:25:51.868885 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-571841f8-5fc2-4f82-a0a6-022468d4eb97 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:25:51.894641 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-571841f8-5fc2-4f82-a0a6-022468d4eb97 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:25:51.895389 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-571841f8-5fc2-4f82-a0a6-022468d4eb97 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:25:51.896395 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-571841f8-5fc2-4f82-a0a6-022468d4eb97 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:25:51.897008 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-571841f8-5fc2-4f82-a0a6-022468d4eb97 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:25:51.990936 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-571841f8-5fc2-4f82-a0a6-022468d4eb97 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Getting quotas for project b044b1d7d5474351bd94eb1c90882933. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:25:52.025744 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-571841f8-5fc2-4f82-a0a6-022468d4eb97 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Getting quotas for user bdc9e59d03334b72a8052e0f1112523f and project b044b1d7d5474351bd94eb1c90882933. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:25:52.049534 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-571841f8-5fc2-4f82-a0a6-022468d4eb97 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Going to run 1 instances... {{(pid=117829) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:25:52.056716 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-571841f8-5fc2-4f82-a0a6-022468d4eb97 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d6b971e-8afe-4e4a-b054-20cd61970c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117829) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:25:52.171441 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-571841f8-5fc2-4f82-a0a6-022468d4eb97 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.073127 Jul 20 08:25:52.173895 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 11/32] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Jul 20 08:25:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 4077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 08:25:52.189198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-129edbcf-7d6f-440b-af01-5511bd5d30a7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:52.190823 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-129edbcf-7d6f-440b-af01-5511bd5d30a7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:25:52.594340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-df39dd71-6bff-4948-96c3-7862847341c4 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39bb0c670>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:52.692121 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-df39dd71-6bff-4948-96c3-7862847341c4 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0" status: 200 len: 287 microversion: 2.1 time: 0.113029 Jul 20 08:25:52.693754 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 12/33] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Jul 20 08:25:52 2022] GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0 => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:25:52.826425 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-129edbcf-7d6f-440b-af01-5511bd5d30a7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:25:52.892030 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-129edbcf-7d6f-440b-af01-5511bd5d30a7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1222 microversion: 2.1 time: 0.709194 Jul 20 08:25:52.895029 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 22/34] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:25:52 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1222 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:25:53.150058 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f8ea68a5-cfc5-45cc-b897-7d668845b422 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1664336638", "imageRef": "5d6b971e-8afe-4e4a-b054-20cd61970c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:25:53.420033 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.network.neutron [None req-f8ea68a5-cfc5-45cc-b897-7d668845b422 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] validate_networks() for [('c96fa3a3-1d61-4869-813f-bb65cb182cb7', None, None, None, None, None)] {{(pid=117829) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:25:53.709380 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c3c1ba11-688b-4c1b-90b0-f6aa851ed8fa tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39b29ee50>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:53.869588 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c3c1ba11-688b-4c1b-90b0-f6aa851ed8fa tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0" status: 200 len: 287 microversion: 2.1 time: 0.167764 Jul 20 08:25:53.870536 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 23/35] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Jul 20 08:25:53 2022] GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0 => generated 287 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:25:54.768742 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-f8ea68a5-cfc5-45cc-b897-7d668845b422 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Flavor limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:25:54.771012 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-f8ea68a5-cfc5-45cc-b897-7d668845b422 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Image limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:25:54.772358 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-f8ea68a5-cfc5-45cc-b897-7d668845b422 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Flavor pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:25:54.773886 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-f8ea68a5-cfc5-45cc-b897-7d668845b422 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Image pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:25:54.775181 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-f8ea68a5-cfc5-45cc-b897-7d668845b422 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:25:54.828069 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f8ea68a5-cfc5-45cc-b897-7d668845b422 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:25:54.828379 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f8ea68a5-cfc5-45cc-b897-7d668845b422 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:25:54.830007 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f8ea68a5-cfc5-45cc-b897-7d668845b422 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:25:54.831401 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f8ea68a5-cfc5-45cc-b897-7d668845b422 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:25:54.871471 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-f8ea68a5-cfc5-45cc-b897-7d668845b422 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Getting quotas for project b044b1d7d5474351bd94eb1c90882933. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:25:54.877237 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-f8ea68a5-cfc5-45cc-b897-7d668845b422 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Getting quotas for user bdc9e59d03334b72a8052e0f1112523f and project b044b1d7d5474351bd94eb1c90882933. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:25:54.884124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-17260e28-9237-462a-b2de-c53f86839e12 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39b2685e0>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:54.892760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f8ea68a5-cfc5-45cc-b897-7d668845b422 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Going to run 1 instances... {{(pid=117829) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:25:54.895470 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f8ea68a5-cfc5-45cc-b897-7d668845b422 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d6b971e-8afe-4e4a-b054-20cd61970c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117829) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:25:54.940765 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-17260e28-9237-462a-b2de-c53f86839e12 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] HTTP exception thrown: Snapshot 8e53c3da-cabc-414e-bba7-60b619c3dac0 could not be found. Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-17260e28-9237-462a-b2de-c53f86839e12 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Request method failure captured: Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0 HTTP/1.1 Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wACsuOqxfKI1ReGtnZUHeBvdufIb4F3w_PPuBBM4_Us4mk75z3PJOcXRVTtoZM3pBfvlbiAxr3MQnybYKOm_VkL0enpIOEv0mW7Zs0Tjjp4roCjOhb5qc7tLmi7Vvtq0H6C3d8SVDbxr_bqumk0AUOeMAr0J1QcAwFjSqXGypXXtI Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: 5b8be62fec184cf2872763f6e73b520d Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1374114967 Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:25:54.943319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:25:54.944607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5b8be62fec184cf2872763f6e73b520d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5b8be62fec184cf2872763f6e73b520d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5b8be62fec184cf2872763f6e73b520d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5b8be62fec184cf2872763f6e73b520d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:25:54.944607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1374114967 Jul 20 08:25:54.944607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: 5b8be62fec184cf2872763f6e73b520d Jul 20 08:25:54.944607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1374114967 Jul 20 08:25:54.944607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-VolumesSnapshotsTestJSON-1374114967-project Jul 20 08:25:54.944607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:25:54.944607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:25:54.944607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: 4421872df5964fcd8269fb6abc45d943 Jul 20 08:25:54.944607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1374114967-project Jul 20 08:25:54.944607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: Jul 20 08:25:54.944607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Snapshot 8e53c3da-cabc-414e-bba7-60b619c3dac0 could not be found. Jul 20 08:25:54.944607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': '8e53c3da-cabc-414e-bba7-60b619c3dac0'} Jul 20 08:25:54.944607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:25:54.945401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:54.945401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 08:25:54.945401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 08:25:54.945401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 08:25:54.945401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 08:25:54.945401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 08:25:54.945401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 08:25:54.945401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 08:25:54.945401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 08:25:54.945401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 08:25:54.945401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 08:25:54.945401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 08:25:54.945401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 08:25:54.945401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 08:25:54.945401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 08:25:54.945401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8e53c3da-cabc-414e-bba7-60b619c3dac0 could not be found. (HTTP 404) (Request-ID: req-6040f001-7b1a-4717-9610-403b894fee77) Jul 20 08:25:54.945401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:54.945401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:54.946449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:54.946449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:54.946449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 20 08:25:54.946449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 20 08:25:54.946449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 08:25:54.946449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 08:25:54.946449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 20 08:25:54.946449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 20 08:25:54.946449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 08:25:54.946449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 08:25:54.946449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 08:25:54.946449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 08:25:54.946449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 08:25:54.946449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 08:25:54.946449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 08:25:54.946449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 08:25:54.946449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 08:25:54.946449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 08:25:54.946449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 08:25:54.947567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 08:25:54.947567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 08:25:54.947567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 08:25:54.947567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 08:25:54.947567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 08:25:54.947567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8e53c3da-cabc-414e-bba7-60b619c3dac0 could not be found. Jul 20 08:25:54.947567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:54.947567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:54.947567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:54.947567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:54.947567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:54.947567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:54.947567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:25:54.947567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:25:54.947567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 08:25:54.947567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 08:25:54.947567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:25:54.947567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:25:54.947567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 20 08:25:54.947567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:25:54.948678 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8e53c3da-cabc-414e-bba7-60b619c3dac0 could not be found. Jul 20 08:25:54.948678 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:54.948678 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:54.948678 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:54.948678 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:54.948678 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:54.948678 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:54.948678 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:25:54.948678 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:25:54.948678 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8e53c3da-cabc-414e-bba7-60b619c3dac0 could not be found. Jul 20 08:25:54.948678 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:25:54.950847 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-17260e28-9237-462a-b2de-c53f86839e12 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Returning 404 to user: Snapshot 8e53c3da-cabc-414e-bba7-60b619c3dac0 could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:25:54.951565 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-17260e28-9237-462a-b2de-c53f86839e12 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0" status: 404 len: 111 microversion: 2.1 time: 0.071876 Jul 20 08:25:54.952725 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 24/36] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Jul 20 08:25:54 2022] GET /compute/v2.1/os-snapshots/8e53c3da-cabc-414e-bba7-60b619c3dac0 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:25:54.968451 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-64ab9493-308f-4f74-8bfe-92c886126d24 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39b268430>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:55.025128 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f8ea68a5-cfc5-45cc-b897-7d668845b422 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.885246 Jul 20 08:25:55.028696 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 13/37] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Jul 20 08:25:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 08:25:55.052886 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4549df37-45d5-41e3-95b4-aa8470d31738 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:55.054992 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4549df37-45d5-41e3-95b4-aa8470d31738 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:25:55.210715 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-64ab9493-308f-4f74-8bfe-92c886126d24 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/cba62521-455e-4762-be54-95cca9d85e96" status: 202 len: 0 microversion: 2.1 time: 0.248954 Jul 20 08:25:55.212049 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 25/38] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Jul 20 08:25:54 2022] DELETE /compute/v2.1/os-volumes/cba62521-455e-4762-be54-95cca9d85e96 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:25:55.225415 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c05df654-352c-4746-9eb7-b7fd9796f38d tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39b268dc0>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:55.369032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c05df654-352c-4746-9eb7-b7fd9796f38d tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/cba62521-455e-4762-be54-95cca9d85e96" status: 200 len: 344 microversion: 2.1 time: 0.150801 Jul 20 08:25:55.370392 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 26/39] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Jul 20 08:25:55 2022] GET /compute/v2.1/os-volumes/cba62521-455e-4762-be54-95cca9d85e96 => generated 344 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:25:55.390067 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4549df37-45d5-41e3-95b4-aa8470d31738 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:25:55.434791 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4549df37-45d5-41e3-95b4-aa8470d31738 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1222 microversion: 2.1 time: 0.396448 Jul 20 08:25:55.440793 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 14/40] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:25:55 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1222 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:25:55.976462 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8f6ae3b7-9507-4f2b-b155-9426204fa0bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1970500035", "imageRef": "5d6b971e-8afe-4e4a-b054-20cd61970c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "493487e7-e371-48c4-94a1-b290ee37dc8e"}], "security_groups": [{"name": "tempest-securitygroup--1804374244"}], "key_name": "tempest-keypair-972139346", "user_data": "}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:25:56.387337 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-fd30ab01-edb6-44c8-a49a-3ea854b322b1 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39bb0c820>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:56.458181 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-fd30ab01-edb6-44c8-a49a-3ea854b322b1 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] HTTP exception thrown: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-fd30ab01-edb6-44c8-a49a-3ea854b322b1 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Request method failure captured: Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: GET /compute/v2.1/os-volumes/cba62521-455e-4762-be54-95cca9d85e96 HTTP/1.1 Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17wACsuOqxfKI1ReGtnZUHeBvdufIb4F3w_PPuBBM4_Us4mk75z3PJOcXRVTtoZM3pBfvlbiAxr3MQnybYKOm_VkL0enpIOEv0mW7Zs0Tjjp4roCjOhb5qc7tLmi7Vvtq0H6C3d8SVDbxr_bqumk0AUOeMAr0J1QcAwFjSqXGypXXtI Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: 5b8be62fec184cf2872763f6e73b520d Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1374114967 Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:25:56.477234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:25:56.479735 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5b8be62fec184cf2872763f6e73b520d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5b8be62fec184cf2872763f6e73b520d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5b8be62fec184cf2872763f6e73b520d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5b8be62fec184cf2872763f6e73b520d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:25:56.479735 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1374114967 Jul 20 08:25:56.479735 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: 5b8be62fec184cf2872763f6e73b520d Jul 20 08:25:56.479735 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1374114967 Jul 20 08:25:56.479735 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-VolumesSnapshotsTestJSON-1374114967-project Jul 20 08:25:56.479735 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:25:56.479735 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:25:56.479735 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: 4421872df5964fcd8269fb6abc45d943 Jul 20 08:25:56.479735 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1374114967-project Jul 20 08:25:56.479735 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: Jul 20 08:25:56.479735 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. Jul 20 08:25:56.479735 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': 'cba62521-455e-4762-be54-95cca9d85e96'} Jul 20 08:25:56.479735 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:25:56.481127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:56.481127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 08:25:56.481127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 08:25:56.481127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 08:25:56.481127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 08:25:56.481127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 08:25:56.481127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 08:25:56.481127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 08:25:56.481127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 08:25:56.481127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 08:25:56.481127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 08:25:56.481127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 08:25:56.481127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 08:25:56.481127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 08:25:56.481127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 08:25:56.481127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. (HTTP 404) (Request-ID: req-0a447543-4836-40bf-ac17-baf236d3a49b) Jul 20 08:25:56.481127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:56.481127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:56.481127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:56.483356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:56.483356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 08:25:56.483356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 08:25:56.483356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 08:25:56.483356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 08:25:56.483356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 08:25:56.483356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 08:25:56.483356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 08:25:56.483356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 08:25:56.483356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 08:25:56.483356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 08:25:56.483356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 08:25:56.483356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 08:25:56.483356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 08:25:56.483356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 08:25:56.483356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 08:25:56.483356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 08:25:56.483356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 08:25:56.483356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 08:25:56.498815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 08:25:56.498815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 08:25:56.498815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 08:25:56.498815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 08:25:56.498815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. Jul 20 08:25:56.498815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:56.498815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:56.498815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:56.498815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:56.498815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:56.498815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:56.498815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:25:56.498815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:25:56.498815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 08:25:56.498815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 08:25:56.498815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:25:56.498815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:25:56.498815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 08:25:56.498815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:25:56.508549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. Jul 20 08:25:56.508549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:56.508549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:56.508549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:56.508549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:56.508549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:56.508549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:56.508549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:25:56.508549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:25:56.508549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. Jul 20 08:25:56.508549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:56.508549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-fd30ab01-edb6-44c8-a49a-3ea854b322b1 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Returning 404 to user: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:25:56.508549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-fd30ab01-edb6-44c8-a49a-3ea854b322b1 tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/cba62521-455e-4762-be54-95cca9d85e96" status: 404 len: 109 microversion: 2.1 time: 0.102494 Jul 20 08:25:56.508549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 15/41] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Jul 20 08:25:56 2022] GET /compute/v2.1/os-volumes/cba62521-455e-4762-be54-95cca9d85e96 => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 08:25:56.511063 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a4474b79-152a-47e6-a394-7d12a0ab159e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:56.516364 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a4474b79-152a-47e6-a394-7d12a0ab159e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:25:56.707074 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a4474b79-152a-47e6-a394-7d12a0ab159e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:25:56.752871 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a4474b79-152a-47e6-a394-7d12a0ab159e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1222 microversion: 2.1 time: 0.248374 Jul 20 08:25:56.753557 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 16/42] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:25:56 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1222 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:25:56.779061 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-cbaa508b-70e3-4658-83c1-d07d4bdc3f6d tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39aa1e1f0>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:56.892562 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-cbaa508b-70e3-4658-83c1-d07d4bdc3f6d tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] HTTP exception thrown: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-cbaa508b-70e3-4658-83c1-d07d4bdc3f6d tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Request method failure captured: Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: DELETE /compute/v2.1/os-volumes/cba62521-455e-4762-be54-95cca9d85e96 HTTP/1.1 Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17wACsuOqxfKI1ReGtnZUHeBvdufIb4F3w_PPuBBM4_Us4mk75z3PJOcXRVTtoZM3pBfvlbiAxr3MQnybYKOm_VkL0enpIOEv0mW7Zs0Tjjp4roCjOhb5qc7tLmi7Vvtq0H6C3d8SVDbxr_bqumk0AUOeMAr0J1QcAwFjSqXGypXXtI Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: 5b8be62fec184cf2872763f6e73b520d Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1374114967 Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:25:56.895136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:25:56.897760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5b8be62fec184cf2872763f6e73b520d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5b8be62fec184cf2872763f6e73b520d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5b8be62fec184cf2872763f6e73b520d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5b8be62fec184cf2872763f6e73b520d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:25:56.897760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1374114967 Jul 20 08:25:56.897760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: 5b8be62fec184cf2872763f6e73b520d Jul 20 08:25:56.897760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1374114967 Jul 20 08:25:56.897760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-VolumesSnapshotsTestJSON-1374114967-project Jul 20 08:25:56.897760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:25:56.897760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:25:56.897760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: 4421872df5964fcd8269fb6abc45d943 Jul 20 08:25:56.897760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1374114967-project Jul 20 08:25:56.897760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: Jul 20 08:25:56.897760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. Jul 20 08:25:56.897760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': 'cba62521-455e-4762-be54-95cca9d85e96'} Jul 20 08:25:56.897760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:25:56.903748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:56.903748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 08:25:56.903748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 08:25:56.903748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 08:25:56.903748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 08:25:56.903748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 08:25:56.903748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 08:25:56.903748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 08:25:56.903748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 08:25:56.903748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 08:25:56.903748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 08:25:56.903748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 08:25:56.903748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 08:25:56.903748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 08:25:56.903748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 08:25:56.903748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. (HTTP 404) (Request-ID: req-76a41a15-9c5e-4ede-bbe4-87c67b40387d) Jul 20 08:25:56.903748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:56.903748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:56.903748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:56.907224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:56.907224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 08:25:56.907224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 08:25:56.907224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 08:25:56.907224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 08:25:56.907224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 08:25:56.907224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 08:25:56.907224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 08:25:56.907224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 08:25:56.907224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 08:25:56.907224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 08:25:56.907224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 08:25:56.907224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 08:25:56.907224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 08:25:56.907224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 08:25:56.907224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 08:25:56.907224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 08:25:56.907224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 08:25:56.907224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 08:25:56.912296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 08:25:56.912296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 08:25:56.912296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 08:25:56.912296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 08:25:56.912296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. Jul 20 08:25:56.912296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:56.912296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:56.912296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:56.912296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:56.912296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:56.912296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:56.912296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:25:56.912296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:25:56.912296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 08:25:56.912296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 08:25:56.912296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:25:56.912296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:25:56.912296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 08:25:56.912296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:25:56.915876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. Jul 20 08:25:56.915876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:56.915876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:56.915876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:56.915876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:56.915876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:56.915876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:56.915876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:25:56.915876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:25:56.915876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. Jul 20 08:25:56.915876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:56.915876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-cbaa508b-70e3-4658-83c1-d07d4bdc3f6d tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Returning 404 to user: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:25:56.915876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-cbaa508b-70e3-4658-83c1-d07d4bdc3f6d tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/cba62521-455e-4762-be54-95cca9d85e96" status: 404 len: 109 microversion: 2.1 time: 0.140599 Jul 20 08:25:56.915876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 17/43] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Jul 20 08:25:56 2022] DELETE /compute/v2.1/os-volumes/cba62521-455e-4762-be54-95cca9d85e96 => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:25:56.924030 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-7e438fc9-3c8d-4c45-85a5-18d766913c4d tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Calling method '.version_select at 0x7fe39aa1eee0>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:57.014932 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-7e438fc9-3c8d-4c45-85a5-18d766913c4d tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] HTTP exception thrown: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-7e438fc9-3c8d-4c45-85a5-18d766913c4d tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Request method failure captured: Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: GET /compute/v2.1/os-volumes/cba62521-455e-4762-be54-95cca9d85e96 HTTP/1.1 Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17wACsuOqxfKI1ReGtnZUHeBvdufIb4F3w_PPuBBM4_Us4mk75z3PJOcXRVTtoZM3pBfvlbiAxr3MQnybYKOm_VkL0enpIOEv0mW7Zs0Tjjp4roCjOhb5qc7tLmi7Vvtq0H6C3d8SVDbxr_bqumk0AUOeMAr0J1QcAwFjSqXGypXXtI Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: 5b8be62fec184cf2872763f6e73b520d Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1374114967 Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:25:57.033639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:25:57.036532 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5b8be62fec184cf2872763f6e73b520d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5b8be62fec184cf2872763f6e73b520d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5b8be62fec184cf2872763f6e73b520d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5b8be62fec184cf2872763f6e73b520d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:25:57.036532 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1374114967 Jul 20 08:25:57.036532 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: 5b8be62fec184cf2872763f6e73b520d Jul 20 08:25:57.036532 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1374114967 Jul 20 08:25:57.036532 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-VolumesSnapshotsTestJSON-1374114967-project Jul 20 08:25:57.036532 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:25:57.036532 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:25:57.036532 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: 4421872df5964fcd8269fb6abc45d943 Jul 20 08:25:57.036532 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1374114967-project Jul 20 08:25:57.036532 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: Jul 20 08:25:57.036532 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. Jul 20 08:25:57.036532 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': 'cba62521-455e-4762-be54-95cca9d85e96'} Jul 20 08:25:57.036532 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:25:57.038292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:57.038292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 08:25:57.038292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 08:25:57.038292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 08:25:57.038292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 08:25:57.038292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 08:25:57.038292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 08:25:57.038292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 08:25:57.038292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 08:25:57.038292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 08:25:57.038292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 08:25:57.038292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 08:25:57.038292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 08:25:57.038292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 08:25:57.038292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 08:25:57.038292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. (HTTP 404) (Request-ID: req-30fb83d7-6055-400d-9b7e-7bf9618d05b6) Jul 20 08:25:57.038292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:57.038292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:57.038292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:57.040789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:57.040789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 08:25:57.040789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 08:25:57.040789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 08:25:57.040789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 08:25:57.040789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 08:25:57.040789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 08:25:57.040789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 08:25:57.040789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 08:25:57.040789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 08:25:57.040789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 08:25:57.040789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 08:25:57.040789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 08:25:57.040789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 08:25:57.040789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 08:25:57.040789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 08:25:57.040789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 08:25:57.040789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 08:25:57.040789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 08:25:57.044487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 08:25:57.044487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 08:25:57.044487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 08:25:57.044487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 08:25:57.044487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. Jul 20 08:25:57.044487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:57.044487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:57.044487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:57.044487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:57.044487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:57.044487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:57.044487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:25:57.044487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:25:57.044487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 08:25:57.044487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 08:25:57.044487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:25:57.044487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:25:57.044487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 08:25:57.044487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:25:57.049587 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. Jul 20 08:25:57.049587 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:57.049587 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:25:57.049587 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:57.049587 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:25:57.049587 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:25:57.049587 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:25:57.049587 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:25:57.049587 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:25:57.049587 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. Jul 20 08:25:57.049587 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:25:57.055422 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-7e438fc9-3c8d-4c45-85a5-18d766913c4d tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] Returning 404 to user: Volume cba62521-455e-4762-be54-95cca9d85e96 could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:25:57.060144 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-7e438fc9-3c8d-4c45-85a5-18d766913c4d tempest-VolumesSnapshotsTestJSON-1374114967 tempest-VolumesSnapshotsTestJSON-1374114967-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/cba62521-455e-4762-be54-95cca9d85e96" status: 404 len: 109 microversion: 2.1 time: 0.154464 Jul 20 08:25:57.066287 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 18/44] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Jul 20 08:25:56 2022] GET /compute/v2.1/os-volumes/cba62521-455e-4762-be54-95cca9d85e96 => generated 109 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 08:25:57.575613 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.network.neutron [None req-8f6ae3b7-9507-4f2b-b155-9426204fa0bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] validate_networks() for [('493487e7-e371-48c4-94a1-b290ee37dc8e', None, None, None, None, None)] {{(pid=117828) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:25:57.790826 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-cb3d5481-e9d6-4181-822e-8d1e7ce106ce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:25:57.793482 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-cb3d5481-e9d6-4181-822e-8d1e7ce106ce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:25:57.862116 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cb3d5481-e9d6-4181-822e-8d1e7ce106ce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:25:57.865544 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cb3d5481-e9d6-4181-822e-8d1e7ce106ce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:25:57.871934 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cb3d5481-e9d6-4181-822e-8d1e7ce106ce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:25:57.874191 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cb3d5481-e9d6-4181-822e-8d1e7ce106ce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:25:59.852337 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-cb3d5481-e9d6-4181-822e-8d1e7ce106ce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:25:59.915091 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-cb3d5481-e9d6-4181-822e-8d1e7ce106ce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1226 microversion: 2.1 time: 2.133808 Jul 20 08:25:59.921035 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 19/45] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:25:57 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1226 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:00.946255 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-78ff7982-67f7-407e-bc08-9a6527c24cad tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:00.946930 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-78ff7982-67f7-407e-bc08-9a6527c24cad tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:00.968900 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-78ff7982-67f7-407e-bc08-9a6527c24cad tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:00.973840 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-78ff7982-67f7-407e-bc08-9a6527c24cad tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:00.975701 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-78ff7982-67f7-407e-bc08-9a6527c24cad tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:00.978630 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-78ff7982-67f7-407e-bc08-9a6527c24cad tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:01.526879 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-78ff7982-67f7-407e-bc08-9a6527c24cad tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:01.554083 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-78ff7982-67f7-407e-bc08-9a6527c24cad tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1226 microversion: 2.1 time: 0.611252 Jul 20 08:26:01.555864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 20/46] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:00 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1226 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:02.591761 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3702f0a9-f247-4e99-a0dd-49624ad31c17 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:02.597552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3702f0a9-f247-4e99-a0dd-49624ad31c17 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:02.639963 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3702f0a9-f247-4e99-a0dd-49624ad31c17 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:02.643539 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3702f0a9-f247-4e99-a0dd-49624ad31c17 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:02.648023 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3702f0a9-f247-4e99-a0dd-49624ad31c17 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:02.654765 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3702f0a9-f247-4e99-a0dd-49624ad31c17 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:02.874346 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=6 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:03.124438 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3702f0a9-f247-4e99-a0dd-49624ad31c17 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:03.162164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3702f0a9-f247-4e99-a0dd-49624ad31c17 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1274 microversion: 2.1 time: 0.580499 Jul 20 08:26:03.173387 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 21/47] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:02 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1274 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:03.923055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-8f6ae3b7-9507-4f2b-b155-9426204fa0bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Flavor limits 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:26:03.924221 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-8f6ae3b7-9507-4f2b-b155-9426204fa0bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Image limits 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:26:03.924221 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-8f6ae3b7-9507-4f2b-b155-9426204fa0bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Flavor pref 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:26:03.924534 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-8f6ae3b7-9507-4f2b-b155-9426204fa0bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Image pref 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:26:03.924729 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-8f6ae3b7-9507-4f2b-b155-9426204fa0bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:26:03.957321 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8f6ae3b7-9507-4f2b-b155-9426204fa0bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:03.957775 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8f6ae3b7-9507-4f2b-b155-9426204fa0bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:03.958617 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8f6ae3b7-9507-4f2b-b155-9426204fa0bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:03.963799 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8f6ae3b7-9507-4f2b-b155-9426204fa0bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:04.108631 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-8f6ae3b7-9507-4f2b-b155-9426204fa0bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Getting quotas for project 80faf6362e244bb992ffb6058ceeefda. Resources: {'cores', 'ram', 'instances'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:26:04.130504 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-8f6ae3b7-9507-4f2b-b155-9426204fa0bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Getting quotas for user fb5f0f7e59dd4c548a6ea72bb25f1ebb and project 80faf6362e244bb992ffb6058ceeefda. Resources: {'cores', 'ram', 'instances'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:26:04.196300 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-1cee21cc-2f17-484a-87bb-ee40693a9da4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:04.198746 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-1cee21cc-2f17-484a-87bb-ee40693a9da4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:04.213522 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8f6ae3b7-9507-4f2b-b155-9426204fa0bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Going to run 1 instances... {{(pid=117828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:26:04.229702 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1cee21cc-2f17-484a-87bb-ee40693a9da4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:04.232239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1cee21cc-2f17-484a-87bb-ee40693a9da4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:04.238173 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1cee21cc-2f17-484a-87bb-ee40693a9da4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:04.239790 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8f6ae3b7-9507-4f2b-b155-9426204fa0bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d6b971e-8afe-4e4a-b054-20cd61970c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:26:04.244024 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1cee21cc-2f17-484a-87bb-ee40693a9da4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:04.662828 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1cee21cc-2f17-484a-87bb-ee40693a9da4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:04.690267 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-1cee21cc-2f17-484a-87bb-ee40693a9da4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1280 microversion: 2.1 time: 0.502329 Jul 20 08:26:04.692597 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 22/48] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:04 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1280 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:04.829006 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8f6ae3b7-9507-4f2b-b155-9426204fa0bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 8.856642 Jul 20 08:26:04.831822 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 27/49] 10.222.0.64 () {62 vars in 1187 bytes} [Wed Jul 20 08:25:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 8861 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 08:26:04.860489 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-2804b084-7d00-4877-97fc-4ec30f34aeff tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:04.861830 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-2804b084-7d00-4877-97fc-4ec30f34aeff tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:04.883756 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=4 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:05.497187 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-2804b084-7d00-4877-97fc-4ec30f34aeff tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:05.528936 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-2804b084-7d00-4877-97fc-4ec30f34aeff tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:05.536152 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-2804b084-7d00-4877-97fc-4ec30f34aeff tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:05.553271 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-2804b084-7d00-4877-97fc-4ec30f34aeff tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1281 microversion: 2.20 time: 0.697076 Jul 20 08:26:05.565738 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 23/50] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:04 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1281 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:05.735205 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3870ec60-f364-434f-ad2b-1e26be7ca5c7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:05.742479 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-3870ec60-f364-434f-ad2b-1e26be7ca5c7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:05.787273 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3870ec60-f364-434f-ad2b-1e26be7ca5c7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:05.789294 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3870ec60-f364-434f-ad2b-1e26be7ca5c7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:05.817259 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3870ec60-f364-434f-ad2b-1e26be7ca5c7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:05.817259 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3870ec60-f364-434f-ad2b-1e26be7ca5c7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:06.587974 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8cbb8121-9e1b-4a94-b7c7-ef7fb47ae7ee tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:06.590342 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8cbb8121-9e1b-4a94-b7c7-ef7fb47ae7ee tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:06.887112 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3870ec60-f364-434f-ad2b-1e26be7ca5c7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:06.957824 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-3870ec60-f364-434f-ad2b-1e26be7ca5c7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1280 microversion: 2.1 time: 1.235129 Jul 20 08:26:06.962947 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 28/51] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:05 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1280 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:07.755369 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8cbb8121-9e1b-4a94-b7c7-ef7fb47ae7ee tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:07.773591 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8cbb8121-9e1b-4a94-b7c7-ef7fb47ae7ee tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:07.786416 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8cbb8121-9e1b-4a94-b7c7-ef7fb47ae7ee tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:07.788284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8cbb8121-9e1b-4a94-b7c7-ef7fb47ae7ee tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1281 microversion: 2.20 time: 1.207843 Jul 20 08:26:07.794116 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 24/52] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:06 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1281 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:07.995065 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3febb52a-e24d-4ca0-ab70-8e2e5daac102 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:07.995921 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-3febb52a-e24d-4ca0-ab70-8e2e5daac102 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:08.049555 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3febb52a-e24d-4ca0-ab70-8e2e5daac102 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:08.060034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3febb52a-e24d-4ca0-ab70-8e2e5daac102 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:08.066423 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3febb52a-e24d-4ca0-ab70-8e2e5daac102 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:08.068553 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3febb52a-e24d-4ca0-ab70-8e2e5daac102 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:08.619486 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3febb52a-e24d-4ca0-ab70-8e2e5daac102 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:08.657892 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-3febb52a-e24d-4ca0-ab70-8e2e5daac102 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1280 microversion: 2.1 time: 0.667250 Jul 20 08:26:08.672688 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 29/53] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:07 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1280 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:08.818356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-94b8fda2-88ac-4518-954f-e888d9356357 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:08.819697 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-94b8fda2-88ac-4518-954f-e888d9356357 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:08.844997 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-94b8fda2-88ac-4518-954f-e888d9356357 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:08.845786 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-94b8fda2-88ac-4518-954f-e888d9356357 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:08.846645 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-94b8fda2-88ac-4518-954f-e888d9356357 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:08.847090 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-94b8fda2-88ac-4518-954f-e888d9356357 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:09.146971 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-94b8fda2-88ac-4518-954f-e888d9356357 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:09.166073 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-94b8fda2-88ac-4518-954f-e888d9356357 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:09.178639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-94b8fda2-88ac-4518-954f-e888d9356357 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:09.186298 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-94b8fda2-88ac-4518-954f-e888d9356357 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1285 microversion: 2.20 time: 0.369875 Jul 20 08:26:09.227955 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 25/54] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:08 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1285 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:09.699068 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3fbfa331-a2a6-4924-8537-5bb5b470c8a3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:09.699685 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3fbfa331-a2a6-4924-8537-5bb5b470c8a3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:09.700872 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-ba616338-8787-470e-b494-61d2eee65982 req-e6683f95-f40e-4adb-8ce1-b4ca9a0be81c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff2ea553-bf93-4f6e-b624-935ecec595b7", "tag": "06458427-d317-4965-817d-8affbd2750e5"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:26:09.714325 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3fbfa331-a2a6-4924-8537-5bb5b470c8a3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:09.714821 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3fbfa331-a2a6-4924-8537-5bb5b470c8a3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:09.715638 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3fbfa331-a2a6-4924-8537-5bb5b470c8a3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:09.716080 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3fbfa331-a2a6-4924-8537-5bb5b470c8a3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:09.744373 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-ba616338-8787-470e-b494-61d2eee65982 req-e6683f95-f40e-4adb-8ce1-b4ca9a0be81c service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:09.747504 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-ba616338-8787-470e-b494-61d2eee65982 req-e6683f95-f40e-4adb-8ce1-b4ca9a0be81c service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:09.818110 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-ba616338-8787-470e-b494-61d2eee65982 req-e6683f95-f40e-4adb-8ce1-b4ca9a0be81c service nova] Creating event network-changed:06458427-d317-4965-817d-8affbd2750e5 for instance ff2ea553-bf93-4f6e-b624-935ecec595b7 on hv-cinder-82308 Jul 20 08:26:09.819080 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-ba616338-8787-470e-b494-61d2eee65982 req-e6683f95-f40e-4adb-8ce1-b4ca9a0be81c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117828) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 08:26:09.821869 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eaaade6b-57fc-4f7b-8f0f-83052e7c5b5d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:09.833340 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eaaade6b-57fc-4f7b-8f0f-83052e7c5b5d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:09.847967 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eaaade6b-57fc-4f7b-8f0f-83052e7c5b5d None None] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:09.848628 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eaaade6b-57fc-4f7b-8f0f-83052e7c5b5d None None] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:09.883571 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.compute.rpcapi [None req-eaaade6b-57fc-4f7b-8f0f-83052e7c5b5d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 08:26:09.887406 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eaaade6b-57fc-4f7b-8f0f-83052e7c5b5d None None] Releasing lock "compute-rpcapi-router" {{(pid=117828) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 08:26:09.935216 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-eaaade6b-57fc-4f7b-8f0f-83052e7c5b5d None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.495638 Jul 20 08:26:09.937052 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 30/55] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:26:10.247221 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f8749a78-53fa-4175-b951-8af6fa7a3645 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:10.248124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f8749a78-53fa-4175-b951-8af6fa7a3645 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:10.257205 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3fbfa331-a2a6-4924-8537-5bb5b470c8a3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:10.264278 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f8749a78-53fa-4175-b951-8af6fa7a3645 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:10.264728 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f8749a78-53fa-4175-b951-8af6fa7a3645 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:10.282152 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f8749a78-53fa-4175-b951-8af6fa7a3645 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:10.287603 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f8749a78-53fa-4175-b951-8af6fa7a3645 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:10.336436 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3fbfa331-a2a6-4924-8537-5bb5b470c8a3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.637678 Jul 20 08:26:10.370374 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 26/56] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:09 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:10.691735 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f8749a78-53fa-4175-b951-8af6fa7a3645 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:10.725629 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f8749a78-53fa-4175-b951-8af6fa7a3645 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:10.733839 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f8749a78-53fa-4175-b951-8af6fa7a3645 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:10.739528 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f8749a78-53fa-4175-b951-8af6fa7a3645 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1277 microversion: 2.20 time: 0.501377 Jul 20 08:26:10.741145 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 31/57] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:10 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1277 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:26:11.370977 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-65c223db-e868-4cb2-8eed-26c19d1e123c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:11.374064 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-65c223db-e868-4cb2-8eed-26c19d1e123c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:11.411665 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-65c223db-e868-4cb2-8eed-26c19d1e123c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:11.418864 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-65c223db-e868-4cb2-8eed-26c19d1e123c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:11.420727 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-65c223db-e868-4cb2-8eed-26c19d1e123c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:11.421883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-65c223db-e868-4cb2-8eed-26c19d1e123c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:11.474414 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-7d5d70c0-ac10-4af7-bcf3-62345178c936 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Action: 'create', calling method: .version_select at 0x7fe39a9bd550>, body: {"keypair": {"name": "tempest-keypair-512431741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCUmyVxDG7W4ftqI52YtsaO2aWQSdw2Z6qxmIMI6MtMP1LGTfOxug1kgXIPLQWSce5Oll4RKKa6Zipsro7S+xLg0tp1cF82G/cF0ru6nwRyZpD9+ifGGaM5qvXZtLH/kVA=="}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:26:11.569788 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-7d5d70c0-ac10-4af7-bcf3-62345178c936 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Getting quotas for project 60ee8039b1f4461c996165d5801b91f1. Resources: {'key_pairs'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:26:11.590477 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-7d5d70c0-ac10-4af7-bcf3-62345178c936 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Getting quotas for user e6c2070c6d2a450c887b8ca6b97c4b38 and project 60ee8039b1f4461c996165d5801b91f1. Resources: {'key_pairs'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:26:11.721304 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-7d5d70c0-ac10-4af7-bcf3-62345178c936 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.994845 Jul 20 08:26:11.727499 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 27/58] 10.222.0.64 () {60 vars in 1158 bytes} [Wed Jul 20 08:26:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:26:11.778746 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-2b7b6a20-2758-4588-9fa6-5ccba6c66267 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:11.784147 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-2b7b6a20-2758-4588-9fa6-5ccba6c66267 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:11.812203 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2b7b6a20-2758-4588-9fa6-5ccba6c66267 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:11.820794 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2b7b6a20-2758-4588-9fa6-5ccba6c66267 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:11.823046 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2b7b6a20-2758-4588-9fa6-5ccba6c66267 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:11.824281 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2b7b6a20-2758-4588-9fa6-5ccba6c66267 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:12.712448 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-2b7b6a20-2758-4588-9fa6-5ccba6c66267 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:12.775133 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-2b7b6a20-2758-4588-9fa6-5ccba6c66267 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:12.785204 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-2b7b6a20-2758-4588-9fa6-5ccba6c66267 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:12.816719 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-2b7b6a20-2758-4588-9fa6-5ccba6c66267 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1333 microversion: 2.20 time: 1.043809 Jul 20 08:26:12.828120 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 28/59] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:11 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1333 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:13.851645 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-46f934df-63a2-42f6-8ee0-f325f41c0604 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:13.852941 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-46f934df-63a2-42f6-8ee0-f325f41c0604 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:13.889533 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-46f934df-63a2-42f6-8ee0-f325f41c0604 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:13.890380 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-46f934df-63a2-42f6-8ee0-f325f41c0604 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:13.908490 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-46f934df-63a2-42f6-8ee0-f325f41c0604 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:13.908887 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-46f934df-63a2-42f6-8ee0-f325f41c0604 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:14.173956 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=6 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:14.312568 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-46f934df-63a2-42f6-8ee0-f325f41c0604 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:14.326171 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-46f934df-63a2-42f6-8ee0-f325f41c0604 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:14.338503 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-46f934df-63a2-42f6-8ee0-f325f41c0604 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:14.340196 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-46f934df-63a2-42f6-8ee0-f325f41c0604 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1339 microversion: 2.20 time: 0.501459 Jul 20 08:26:14.341466 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 29/60] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:13 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1339 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:14.963674 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-65c223db-e868-4cb2-8eed-26c19d1e123c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:14.974636 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-65c223db-e868-4cb2-8eed-26c19d1e123c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 3.615829 Jul 20 08:26:14.979451 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 32/61] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:11 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 3622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:15.117445 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-95114eb4-7ae8-4a26-9377-23e8b81a2cfe req-6a290905-7ae4-48dc-9640-c8ea5d3acae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a", "tag": "7f795798-1661-4ba0-bf5a-641687efe8e3"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:26:15.138126 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-95114eb4-7ae8-4a26-9377-23e8b81a2cfe req-6a290905-7ae4-48dc-9640-c8ea5d3acae7 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:15.150737 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-95114eb4-7ae8-4a26-9377-23e8b81a2cfe req-6a290905-7ae4-48dc-9640-c8ea5d3acae7 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:15.212472 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-95114eb4-7ae8-4a26-9377-23e8b81a2cfe req-6a290905-7ae4-48dc-9640-c8ea5d3acae7 service nova] Creating event network-changed:7f795798-1661-4ba0-bf5a-641687efe8e3 for instance ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a on hv-cinder-82308 Jul 20 08:26:15.213329 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-95114eb4-7ae8-4a26-9377-23e8b81a2cfe req-6a290905-7ae4-48dc-9640-c8ea5d3acae7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117829) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 08:26:15.214744 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b846b44b-47df-4fed-9064-ef4899b09c49 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:15.218490 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b846b44b-47df-4fed-9064-ef4899b09c49 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:15.220393 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b846b44b-47df-4fed-9064-ef4899b09c49 None None] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:15.221149 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b846b44b-47df-4fed-9064-ef4899b09c49 None None] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:15.238536 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.compute.rpcapi [None req-b846b44b-47df-4fed-9064-ef4899b09c49 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 08:26:15.239839 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b846b44b-47df-4fed-9064-ef4899b09c49 None None] Releasing lock "compute-rpcapi-router" {{(pid=117829) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 08:26:15.298441 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-b846b44b-47df-4fed-9064-ef4899b09c49 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184795 Jul 20 08:26:15.299144 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 30/62] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:26:15.365653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-80d1e3b3-43b8-4bbd-98e9-f8e2ad7170ae tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:15.366532 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-80d1e3b3-43b8-4bbd-98e9-f8e2ad7170ae tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:15.374024 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-80d1e3b3-43b8-4bbd-98e9-f8e2ad7170ae tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:15.374872 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-80d1e3b3-43b8-4bbd-98e9-f8e2ad7170ae tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:15.376716 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-80d1e3b3-43b8-4bbd-98e9-f8e2ad7170ae tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:15.377443 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-80d1e3b3-43b8-4bbd-98e9-f8e2ad7170ae tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:15.521162 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-80d1e3b3-43b8-4bbd-98e9-f8e2ad7170ae tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:15.535739 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-80d1e3b3-43b8-4bbd-98e9-f8e2ad7170ae tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:15.540724 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-80d1e3b3-43b8-4bbd-98e9-f8e2ad7170ae tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:15.542361 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-80d1e3b3-43b8-4bbd-98e9-f8e2ad7170ae tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1339 microversion: 2.20 time: 0.181087 Jul 20 08:26:15.543617 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 33/63] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:15 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1339 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:16.000845 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8829d2f6-591b-4870-aac6-c34319aad83c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:16.002078 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8829d2f6-591b-4870-aac6-c34319aad83c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:16.017147 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8829d2f6-591b-4870-aac6-c34319aad83c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:16.017806 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8829d2f6-591b-4870-aac6-c34319aad83c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:16.018689 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8829d2f6-591b-4870-aac6-c34319aad83c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:16.023973 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8829d2f6-591b-4870-aac6-c34319aad83c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:16.691804 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8829d2f6-591b-4870-aac6-c34319aad83c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:16.745384 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-6dae130d-ff44-4da1-81e8-ecfc40531fe0 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-968921875", "imageRef": "5d6b971e-8afe-4e4a-b054-20cd61970c65", "flavorRef": "452", "networks": [{"uuid": "55fb7f17-dc5d-46da-8831-2cc4e1a41a9d"}]}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:26:16.764054 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8829d2f6-591b-4870-aac6-c34319aad83c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.767569 Jul 20 08:26:16.778734 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 31/64] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:15 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:16.822193 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-b64b80a1-dc14-4e94-8544-6fca3719f042 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:16.823716 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-b64b80a1-dc14-4e94-8544-6fca3719f042 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:16.853182 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b64b80a1-dc14-4e94-8544-6fca3719f042 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:16.857727 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b64b80a1-dc14-4e94-8544-6fca3719f042 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:16.863899 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b64b80a1-dc14-4e94-8544-6fca3719f042 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:16.865074 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b64b80a1-dc14-4e94-8544-6fca3719f042 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:16.959545 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.network.neutron [None req-6dae130d-ff44-4da1-81e8-ecfc40531fe0 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] validate_networks() for [('55fb7f17-dc5d-46da-8831-2cc4e1a41a9d', None, None, None, None, None)] {{(pid=117828) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:26:17.107979 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b64b80a1-dc14-4e94-8544-6fca3719f042 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:17.112908 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=67 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:17.167819 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b64b80a1-dc14-4e94-8544-6fca3719f042 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:17.185605 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b64b80a1-dc14-4e94-8544-6fca3719f042 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:17.189248 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-b64b80a1-dc14-4e94-8544-6fca3719f042 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1339 microversion: 2.20 time: 0.388202 Jul 20 08:26:17.195174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 32/65] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:16 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1339 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:18.172160 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-62ec0276-fe4f-4fe7-ad64-a0bc56d4660d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Action: 'create', calling method: .version_select at 0x7fe39a937c10>, body: {"keypair": {"name": "tempest-keypair-543427259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxNJ69uraz3VP4r3/9FwL3Zzb+EWdmeWHKRAhSVAvyS/lcVD0soUfDVbVmaGgZMI0he/b83Q8+raCFmx4tK2JQ7bUay/XcWj0CL4PAj0nJ0Tcwafvs8fmAl1IPvr9DdmQ=="}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:26:18.209943 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:18.278991 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=25 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:18.289969 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-62ec0276-fe4f-4fe7-ad64-a0bc56d4660d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Getting quotas for project fa4764ea3c4f4bf98ea56ee0798adfdc. Resources: {'key_pairs'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:26:18.324548 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-62ec0276-fe4f-4fe7-ad64-a0bc56d4660d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Getting quotas for user b2326ff15f294e15806d8a564770b35e and project fa4764ea3c4f4bf98ea56ee0798adfdc. Resources: {'key_pairs'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:26:18.418748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-62ec0276-fe4f-4fe7-ad64-a0bc56d4660d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.220004 Jul 20 08:26:18.420314 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 33/66] 10.222.0.64 () {60 vars in 1158 bytes} [Wed Jul 20 08:26:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:26:18.426735 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d28df426-bd0e-47a3-86bd-d4933b416ee9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:18.427776 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d28df426-bd0e-47a3-86bd-d4933b416ee9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:18.437610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d28df426-bd0e-47a3-86bd-d4933b416ee9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:18.438715 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d28df426-bd0e-47a3-86bd-d4933b416ee9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:18.442275 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d28df426-bd0e-47a3-86bd-d4933b416ee9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:18.444758 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d28df426-bd0e-47a3-86bd-d4933b416ee9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:18.641483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-6dae130d-ff44-4da1-81e8-ecfc40531fe0 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Flavor limits 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:26:18.642835 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-6dae130d-ff44-4da1-81e8-ecfc40531fe0 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Image limits 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:26:18.643498 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-6dae130d-ff44-4da1-81e8-ecfc40531fe0 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Flavor pref 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:26:18.644094 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-6dae130d-ff44-4da1-81e8-ecfc40531fe0 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Image pref 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:26:18.644744 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-6dae130d-ff44-4da1-81e8-ecfc40531fe0 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:26:18.650760 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:18.659920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6dae130d-ff44-4da1-81e8-ecfc40531fe0 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:18.663868 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6dae130d-ff44-4da1-81e8-ecfc40531fe0 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:18.665084 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6dae130d-ff44-4da1-81e8-ecfc40531fe0 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:18.665734 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6dae130d-ff44-4da1-81e8-ecfc40531fe0 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:18.690374 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-6dae130d-ff44-4da1-81e8-ecfc40531fe0 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Getting quotas for project 1b481fa73344413d85fc2eb5c0376c9d. Resources: {'cores', 'ram', 'instances'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:26:18.696220 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-6dae130d-ff44-4da1-81e8-ecfc40531fe0 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Getting quotas for user 5bf1a059ddb34c2d8181712f53d592c2 and project 1b481fa73344413d85fc2eb5c0376c9d. Resources: {'cores', 'ram', 'instances'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:26:18.712655 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-6dae130d-ff44-4da1-81e8-ecfc40531fe0 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Going to run 1 instances... {{(pid=117828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:26:18.721571 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-6dae130d-ff44-4da1-81e8-ecfc40531fe0 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d6b971e-8afe-4e4a-b054-20cd61970c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:26:18.833976 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-6dae130d-ff44-4da1-81e8-ecfc40531fe0 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.440942 Jul 20 08:26:18.842526 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 34/67] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Jul 20 08:26:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 08:26:18.864456 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-80dc0292-bb27-4ccb-a3ac-1e0d0250b86d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:18.876391 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-80dc0292-bb27-4ccb-a3ac-1e0d0250b86d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:18.914440 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-80dc0292-bb27-4ccb-a3ac-1e0d0250b86d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:18.920674 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-80dc0292-bb27-4ccb-a3ac-1e0d0250b86d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:18.926845 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-80dc0292-bb27-4ccb-a3ac-1e0d0250b86d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:18.928634 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-80dc0292-bb27-4ccb-a3ac-1e0d0250b86d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:19.146882 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-80dc0292-bb27-4ccb-a3ac-1e0d0250b86d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:19.165517 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-80dc0292-bb27-4ccb-a3ac-1e0d0250b86d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:19.175122 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-80dc0292-bb27-4ccb-a3ac-1e0d0250b86d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:19.188423 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-80dc0292-bb27-4ccb-a3ac-1e0d0250b86d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1339 microversion: 2.20 time: 0.341961 Jul 20 08:26:19.192543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 35/68] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:18 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1339 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:19.207337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-360236d4-37c9-4544-983f-26581ebdfcca tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:19.209579 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-360236d4-37c9-4544-983f-26581ebdfcca tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:19.296450 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-360236d4-37c9-4544-983f-26581ebdfcca tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:19.314785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-360236d4-37c9-4544-983f-26581ebdfcca tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1214 microversion: 2.1 time: 0.119074 Jul 20 08:26:19.327761 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 36/69] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:19 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:20.212135 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9e5b0059-f5f1-4b83-986a-7850ee6b4053 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:20.214489 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9e5b0059-f5f1-4b83-986a-7850ee6b4053 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:20.233440 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9e5b0059-f5f1-4b83-986a-7850ee6b4053 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:20.237943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9e5b0059-f5f1-4b83-986a-7850ee6b4053 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:20.242389 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9e5b0059-f5f1-4b83-986a-7850ee6b4053 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:20.243237 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9e5b0059-f5f1-4b83-986a-7850ee6b4053 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:20.582050 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d28df426-bd0e-47a3-86bd-d4933b416ee9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:20.606140 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d28df426-bd0e-47a3-86bd-d4933b416ee9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 2.183978 Jul 20 08:26:20.615239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 34/70] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:18 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 2192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:20.635163 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-10010972-9049-4e53-9d65-9b62dc89884c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:20.644300 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-10010972-9049-4e53-9d65-9b62dc89884c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:20.683367 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9e5b0059-f5f1-4b83-986a-7850ee6b4053 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:20.707344 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9e5b0059-f5f1-4b83-986a-7850ee6b4053 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:20.709132 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-10010972-9049-4e53-9d65-9b62dc89884c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:20.713848 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-10010972-9049-4e53-9d65-9b62dc89884c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:20.718417 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9e5b0059-f5f1-4b83-986a-7850ee6b4053 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:20.718705 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-10010972-9049-4e53-9d65-9b62dc89884c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:20.722328 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-10010972-9049-4e53-9d65-9b62dc89884c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:20.728059 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9e5b0059-f5f1-4b83-986a-7850ee6b4053 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1339 microversion: 2.20 time: 0.520650 Jul 20 08:26:20.733699 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 37/71] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:20 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1339 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:26:20.970641 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9971c2c8-f39a-4be2-a0ce-0652a47071dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-250139636", "imageRef": "5d6b971e-8afe-4e4a-b054-20cd61970c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21da7406-374d-4389-9eee-8af0140c04bf"}], "security_groups": [{"name": "tempest-securitygroup--520254980"}], "key_name": "tempest-keypair-512431741", "user_data": "}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:26:21.312185 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-10010972-9049-4e53-9d65-9b62dc89884c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:21.333939 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-10010972-9049-4e53-9d65-9b62dc89884c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1210 microversion: 2.1 time: 0.705189 Jul 20 08:26:21.345236 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 35/72] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:20 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1210 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:21.655547 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5937198b-833f-4d22-ae28-d69bcbfe4146 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:21.657671 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5937198b-833f-4d22-ae28-d69bcbfe4146 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:21.671489 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5937198b-833f-4d22-ae28-d69bcbfe4146 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:21.675840 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5937198b-833f-4d22-ae28-d69bcbfe4146 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:21.678371 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5937198b-833f-4d22-ae28-d69bcbfe4146 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:21.680940 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5937198b-833f-4d22-ae28-d69bcbfe4146 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:22.121746 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.network.neutron [None req-9971c2c8-f39a-4be2-a0ce-0652a47071dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] validate_networks() for [('21da7406-374d-4389-9eee-8af0140c04bf', None, None, None, None, None)] {{(pid=117828) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:26:22.595345 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5937198b-833f-4d22-ae28-d69bcbfe4146 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:22.606149 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5937198b-833f-4d22-ae28-d69bcbfe4146 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.970505 Jul 20 08:26:22.612863 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 36/73] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:21 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:22.628105 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f2df5477-c867-424f-bf8b-af945d775b52 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:22.632101 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f2df5477-c867-424f-bf8b-af945d775b52 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:22.650264 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f2df5477-c867-424f-bf8b-af945d775b52 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:22.654049 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f2df5477-c867-424f-bf8b-af945d775b52 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:22.655777 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f2df5477-c867-424f-bf8b-af945d775b52 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:22.657877 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f2df5477-c867-424f-bf8b-af945d775b52 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:22.834444 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f2df5477-c867-424f-bf8b-af945d775b52 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:22.846244 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f2df5477-c867-424f-bf8b-af945d775b52 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:22.851760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f2df5477-c867-424f-bf8b-af945d775b52 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:22.853902 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f2df5477-c867-424f-bf8b-af945d775b52 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1339 microversion: 2.20 time: 0.238946 Jul 20 08:26:22.854687 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 37/74] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:22 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1339 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:22.873501 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3446573e-6e09-473d-abbd-7dfef4c753e1 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:22.875739 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3446573e-6e09-473d-abbd-7dfef4c753e1 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:22.883493 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3446573e-6e09-473d-abbd-7dfef4c753e1 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:22.884523 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3446573e-6e09-473d-abbd-7dfef4c753e1 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:22.885607 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3446573e-6e09-473d-abbd-7dfef4c753e1 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:22.886279 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3446573e-6e09-473d-abbd-7dfef4c753e1 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:23.080880 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3446573e-6e09-473d-abbd-7dfef4c753e1 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:23.104146 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3446573e-6e09-473d-abbd-7dfef4c753e1 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1266 microversion: 2.1 time: 0.236378 Jul 20 08:26:23.104767 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 38/75] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:22 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1266 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:23.633427 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6ad05ae7-407f-470f-84a7-647173a2eaf9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:23.634403 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6ad05ae7-407f-470f-84a7-647173a2eaf9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:23.648236 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6ad05ae7-407f-470f-84a7-647173a2eaf9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:23.649027 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6ad05ae7-407f-470f-84a7-647173a2eaf9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:23.650046 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6ad05ae7-407f-470f-84a7-647173a2eaf9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:23.650710 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6ad05ae7-407f-470f-84a7-647173a2eaf9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:23.931046 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-9971c2c8-f39a-4be2-a0ce-0652a47071dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Flavor limits 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:26:23.931558 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-9971c2c8-f39a-4be2-a0ce-0652a47071dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Image limits 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:26:23.932001 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-9971c2c8-f39a-4be2-a0ce-0652a47071dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Flavor pref 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:26:23.932675 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-9971c2c8-f39a-4be2-a0ce-0652a47071dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Image pref 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:26:23.933323 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-9971c2c8-f39a-4be2-a0ce-0652a47071dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:26:23.956801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9971c2c8-f39a-4be2-a0ce-0652a47071dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:23.957250 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9971c2c8-f39a-4be2-a0ce-0652a47071dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:23.958551 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9971c2c8-f39a-4be2-a0ce-0652a47071dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:23.959206 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9971c2c8-f39a-4be2-a0ce-0652a47071dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:24.012132 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-9971c2c8-f39a-4be2-a0ce-0652a47071dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Getting quotas for project 60ee8039b1f4461c996165d5801b91f1. Resources: {'cores', 'ram', 'instances'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:26:24.022783 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-9971c2c8-f39a-4be2-a0ce-0652a47071dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Getting quotas for user e6c2070c6d2a450c887b8ca6b97c4b38 and project 60ee8039b1f4461c996165d5801b91f1. Resources: {'cores', 'ram', 'instances'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:26:24.057160 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9971c2c8-f39a-4be2-a0ce-0652a47071dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Going to run 1 instances... {{(pid=117828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:26:24.062460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9971c2c8-f39a-4be2-a0ce-0652a47071dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d6b971e-8afe-4e4a-b054-20cd61970c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:26:24.225566 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9971c2c8-f39a-4be2-a0ce-0652a47071dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.278657 Jul 20 08:26:24.239616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 38/76] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Jul 20 08:26:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 3294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 08:26:24.254724 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3ba9f6b6-ccb9-4620-a356-e8eb99bf565b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:24.269944 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-3ba9f6b6-ccb9-4620-a356-e8eb99bf565b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:24.314755 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ba9f6b6-ccb9-4620-a356-e8eb99bf565b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:24.316662 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ba9f6b6-ccb9-4620-a356-e8eb99bf565b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:24.320781 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ba9f6b6-ccb9-4620-a356-e8eb99bf565b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:24.321324 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ba9f6b6-ccb9-4620-a356-e8eb99bf565b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:24.571983 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6ad05ae7-407f-470f-84a7-647173a2eaf9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:24.601409 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6ad05ae7-407f-470f-84a7-647173a2eaf9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.973070 Jul 20 08:26:24.614190 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 39/77] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:23 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:24.620223 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-fe661873-9051-40e0-89bc-8022f6e10c70 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:24.621163 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-fe661873-9051-40e0-89bc-8022f6e10c70 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:24.632777 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fe661873-9051-40e0-89bc-8022f6e10c70 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:24.633596 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fe661873-9051-40e0-89bc-8022f6e10c70 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:24.635245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fe661873-9051-40e0-89bc-8022f6e10c70 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:24.636000 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fe661873-9051-40e0-89bc-8022f6e10c70 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:24.957006 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fe661873-9051-40e0-89bc-8022f6e10c70 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:24.975937 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-fe661873-9051-40e0-89bc-8022f6e10c70 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1266 microversion: 2.1 time: 0.357749 Jul 20 08:26:24.977537 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 40/78] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:24 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1266 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:24.983746 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a0a8ec55-7645-49c0-a59a-17810c27a3df tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:24.985345 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a0a8ec55-7645-49c0-a59a-17810c27a3df tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:25.086807 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a0a8ec55-7645-49c0-a59a-17810c27a3df tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:25.096853 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a0a8ec55-7645-49c0-a59a-17810c27a3df tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1240 microversion: 2.1 time: 0.117962 Jul 20 08:26:25.098170 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 41/79] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:24 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1240 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:25.105084 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-7931ccf5-1083-4d1e-85c5-3d924e505928 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1222559236", "imageRef": "5d6b971e-8afe-4e4a-b054-20cd61970c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "00a5ba6c-be0d-47a8-912c-f2b61f6abcd5"}], "security_groups": [{"name": "tempest-securitygroup--153030222"}], "key_name": "tempest-keypair-543427259", "user_data": "}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:26:25.240600 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=2 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:25.385172 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3ba9f6b6-ccb9-4620-a356-e8eb99bf565b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:25.397908 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.network.neutron [None req-7931ccf5-1083-4d1e-85c5-3d924e505928 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] validate_networks() for [('00a5ba6c-be0d-47a8-912c-f2b61f6abcd5', None, None, None, None, None)] {{(pid=117829) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:26:25.405654 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3ba9f6b6-ccb9-4620-a356-e8eb99bf565b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:25.411034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3ba9f6b6-ccb9-4620-a356-e8eb99bf565b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:25.413555 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-3ba9f6b6-ccb9-4620-a356-e8eb99bf565b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 1.172213 Jul 20 08:26:25.414704 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 39/80] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:24 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:25.620315 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f0525048-8391-46ea-808c-9eafc5f6cfcd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:25.621212 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f0525048-8391-46ea-808c-9eafc5f6cfcd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:25.644423 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f0525048-8391-46ea-808c-9eafc5f6cfcd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:25.645158 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f0525048-8391-46ea-808c-9eafc5f6cfcd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:25.646112 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f0525048-8391-46ea-808c-9eafc5f6cfcd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:25.646732 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f0525048-8391-46ea-808c-9eafc5f6cfcd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:25.828179 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f0525048-8391-46ea-808c-9eafc5f6cfcd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:25.838787 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f0525048-8391-46ea-808c-9eafc5f6cfcd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.222098 Jul 20 08:26:25.849443 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 40/81] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:25 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:25.999896 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-6bfd8228-eb04-49b4-b50a-081696f21322 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:26.000359 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-6bfd8228-eb04-49b4-b50a-081696f21322 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:26.014147 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6bfd8228-eb04-49b4-b50a-081696f21322 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:26.014666 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6bfd8228-eb04-49b4-b50a-081696f21322 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:26.015493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6bfd8228-eb04-49b4-b50a-081696f21322 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:26.016492 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6bfd8228-eb04-49b4-b50a-081696f21322 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:26.103537 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-6bfd8228-eb04-49b4-b50a-081696f21322 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:26.112115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-6bfd8228-eb04-49b4-b50a-081696f21322 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1266 microversion: 2.1 time: 0.118306 Jul 20 08:26:26.113416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 41/82] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:25 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1266 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:26.130171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c30abaa4-6d27-45f2-909e-908b026fa521 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:26.130848 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c30abaa4-6d27-45f2-909e-908b026fa521 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:26.138460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c30abaa4-6d27-45f2-909e-908b026fa521 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:26.138953 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c30abaa4-6d27-45f2-909e-908b026fa521 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:26.139992 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c30abaa4-6d27-45f2-909e-908b026fa521 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:26.140605 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c30abaa4-6d27-45f2-909e-908b026fa521 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:26.369767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c30abaa4-6d27-45f2-909e-908b026fa521 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:26.385244 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c30abaa4-6d27-45f2-909e-908b026fa521 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1244 microversion: 2.1 time: 0.262428 Jul 20 08:26:26.389147 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 42/83] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:26 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1244 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:26.434225 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-07166fc3-fb7c-4b81-8e9a-5c786d462c1b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:26.435161 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-07166fc3-fb7c-4b81-8e9a-5c786d462c1b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:26.451781 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-07166fc3-fb7c-4b81-8e9a-5c786d462c1b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:26.452477 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-07166fc3-fb7c-4b81-8e9a-5c786d462c1b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:26.455361 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-07166fc3-fb7c-4b81-8e9a-5c786d462c1b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:26.457483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-07166fc3-fb7c-4b81-8e9a-5c786d462c1b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:26.671689 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-7931ccf5-1083-4d1e-85c5-3d924e505928 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Flavor limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:26:26.673624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-7931ccf5-1083-4d1e-85c5-3d924e505928 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Image limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:26:26.675478 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-7931ccf5-1083-4d1e-85c5-3d924e505928 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Flavor pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:26:26.676618 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-7931ccf5-1083-4d1e-85c5-3d924e505928 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Image pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:26:26.677351 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-7931ccf5-1083-4d1e-85c5-3d924e505928 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:26:26.709909 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7931ccf5-1083-4d1e-85c5-3d924e505928 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:26.711265 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7931ccf5-1083-4d1e-85c5-3d924e505928 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:26.723056 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7931ccf5-1083-4d1e-85c5-3d924e505928 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:26.725022 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7931ccf5-1083-4d1e-85c5-3d924e505928 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:26.822556 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-7931ccf5-1083-4d1e-85c5-3d924e505928 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Getting quotas for project fa4764ea3c4f4bf98ea56ee0798adfdc. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:26:26.845479 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-7931ccf5-1083-4d1e-85c5-3d924e505928 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Getting quotas for user b2326ff15f294e15806d8a564770b35e and project fa4764ea3c4f4bf98ea56ee0798adfdc. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:26:26.949453 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-7931ccf5-1083-4d1e-85c5-3d924e505928 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Going to run 1 instances... {{(pid=117829) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:26:26.956234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-7931ccf5-1083-4d1e-85c5-3d924e505928 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d6b971e-8afe-4e4a-b054-20cd61970c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117829) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:26:27.155914 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-7931ccf5-1083-4d1e-85c5-3d924e505928 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.053704 Jul 20 08:26:27.168851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 42/84] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Jul 20 08:26:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 2060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 08:26:27.179181 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6182dd38-4ff1-4a7c-bc7c-8ac34079851e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:27.186450 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6182dd38-4ff1-4a7c-bc7c-8ac34079851e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:27.201795 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6182dd38-4ff1-4a7c-bc7c-8ac34079851e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:27.204730 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6182dd38-4ff1-4a7c-bc7c-8ac34079851e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:27.210493 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6182dd38-4ff1-4a7c-bc7c-8ac34079851e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:27.232424 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6182dd38-4ff1-4a7c-bc7c-8ac34079851e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:27.458118 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-07166fc3-fb7c-4b81-8e9a-5c786d462c1b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:27.524383 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-07166fc3-fb7c-4b81-8e9a-5c786d462c1b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:27.545949 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-07166fc3-fb7c-4b81-8e9a-5c786d462c1b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:27.559389 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-07166fc3-fb7c-4b81-8e9a-5c786d462c1b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 1.125859 Jul 20 08:26:27.568303 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 43/85] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:26 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:26:27.614010 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-843518d3-d259-4b7c-b433-a2b150d38223 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:27.619355 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-843518d3-d259-4b7c-b433-a2b150d38223 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:27.670003 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-843518d3-d259-4b7c-b433-a2b150d38223 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:27.671654 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-843518d3-d259-4b7c-b433-a2b150d38223 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:27.680222 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-843518d3-d259-4b7c-b433-a2b150d38223 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:27.683246 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-843518d3-d259-4b7c-b433-a2b150d38223 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:28.228954 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-843518d3-d259-4b7c-b433-a2b150d38223 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:28.233769 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=87 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:28.261837 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-843518d3-d259-4b7c-b433-a2b150d38223 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1284 microversion: 2.1 time: 0.688887 Jul 20 08:26:28.269115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 44/86] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:27 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1284 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:28.304304 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-46d0f2ee-3c6c-4400-a377-8211fefcaa1d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:28.310990 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-46d0f2ee-3c6c-4400-a377-8211fefcaa1d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:29.065057 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6182dd38-4ff1-4a7c-bc7c-8ac34079851e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:29.082795 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6182dd38-4ff1-4a7c-bc7c-8ac34079851e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 1.911498 Jul 20 08:26:29.083854 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 43/87] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:27 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:29.101016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d963edce-7b1e-412e-b027-c1b82204fbc7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:29.102470 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d963edce-7b1e-412e-b027-c1b82204fbc7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:29.120395 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d963edce-7b1e-412e-b027-c1b82204fbc7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:29.121337 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d963edce-7b1e-412e-b027-c1b82204fbc7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:29.125787 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d963edce-7b1e-412e-b027-c1b82204fbc7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:29.126902 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d963edce-7b1e-412e-b027-c1b82204fbc7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:29.162057 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-46d0f2ee-3c6c-4400-a377-8211fefcaa1d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:29.179601 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-46d0f2ee-3c6c-4400-a377-8211fefcaa1d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1237 microversion: 2.1 time: 0.908284 Jul 20 08:26:29.186824 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 45/88] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:28 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1237 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:29.210567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-30e448a4-0689-4a33-a47d-45b9874c760d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:29.213441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-30e448a4-0689-4a33-a47d-45b9874c760d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:29.229190 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-30e448a4-0689-4a33-a47d-45b9874c760d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:29.230495 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-30e448a4-0689-4a33-a47d-45b9874c760d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:29.232291 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-30e448a4-0689-4a33-a47d-45b9874c760d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:29.233627 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-30e448a4-0689-4a33-a47d-45b9874c760d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:29.242623 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d963edce-7b1e-412e-b027-c1b82204fbc7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:29.258644 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d963edce-7b1e-412e-b027-c1b82204fbc7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1310 microversion: 2.1 time: 0.170612 Jul 20 08:26:29.260367 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 44/89] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:29 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1310 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:29.292840 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e29df224-ba2e-413f-b073-dfb9c3b2d40d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:29.294151 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e29df224-ba2e-413f-b073-dfb9c3b2d40d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:29.308378 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e29df224-ba2e-413f-b073-dfb9c3b2d40d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:29.309600 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e29df224-ba2e-413f-b073-dfb9c3b2d40d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:29.311334 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e29df224-ba2e-413f-b073-dfb9c3b2d40d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:29.314519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e29df224-ba2e-413f-b073-dfb9c3b2d40d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:29.468083 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e29df224-ba2e-413f-b073-dfb9c3b2d40d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:29.486896 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e29df224-ba2e-413f-b073-dfb9c3b2d40d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1272 microversion: 2.1 time: 0.193509 Jul 20 08:26:29.486896 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 45/90] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:29 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1272 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:29.528100 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-30e448a4-0689-4a33-a47d-45b9874c760d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:29.543479 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-30e448a4-0689-4a33-a47d-45b9874c760d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:29.554154 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-30e448a4-0689-4a33-a47d-45b9874c760d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:29.556372 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-30e448a4-0689-4a33-a47d-45b9874c760d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.363967 Jul 20 08:26:29.587959 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 46/91] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:29 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:30.103649 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-111cf409-632d-4c9f-b07a-859b1e7f3fdc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:30.104895 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-111cf409-632d-4c9f-b07a-859b1e7f3fdc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:30.115986 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-111cf409-632d-4c9f-b07a-859b1e7f3fdc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:30.117422 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-111cf409-632d-4c9f-b07a-859b1e7f3fdc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:30.118334 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-111cf409-632d-4c9f-b07a-859b1e7f3fdc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:30.118868 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-111cf409-632d-4c9f-b07a-859b1e7f3fdc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:30.215225 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-898562b4-0fe7-4168-8601-98d2e41fdfab tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:30.216430 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-898562b4-0fe7-4168-8601-98d2e41fdfab tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:30.233544 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-898562b4-0fe7-4168-8601-98d2e41fdfab tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:30.233985 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-898562b4-0fe7-4168-8601-98d2e41fdfab tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:30.240637 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-898562b4-0fe7-4168-8601-98d2e41fdfab tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:30.241441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-898562b4-0fe7-4168-8601-98d2e41fdfab tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:30.458641 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-111cf409-632d-4c9f-b07a-859b1e7f3fdc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:30.505284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-111cf409-632d-4c9f-b07a-859b1e7f3fdc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.407783 Jul 20 08:26:30.506294 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 46/92] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:30 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:30.519091 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-cf5355db-32da-4515-ba73-be5dca866d1a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:30.520231 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-cf5355db-32da-4515-ba73-be5dca866d1a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:30.528876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cf5355db-32da-4515-ba73-be5dca866d1a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:30.529629 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cf5355db-32da-4515-ba73-be5dca866d1a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:30.531284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cf5355db-32da-4515-ba73-be5dca866d1a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:30.532013 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cf5355db-32da-4515-ba73-be5dca866d1a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:30.569940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-898562b4-0fe7-4168-8601-98d2e41fdfab tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:30.592045 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-898562b4-0fe7-4168-8601-98d2e41fdfab tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1289 microversion: 2.1 time: 0.382550 Jul 20 08:26:30.603957 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 47/93] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:30 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1289 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:30.623545 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0a61fee7-5673-4b33-b111-373d72607393 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:30.625392 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0a61fee7-5673-4b33-b111-373d72607393 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:30.651369 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0a61fee7-5673-4b33-b111-373d72607393 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:30.652708 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0a61fee7-5673-4b33-b111-373d72607393 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:30.658446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0a61fee7-5673-4b33-b111-373d72607393 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:30.659256 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0a61fee7-5673-4b33-b111-373d72607393 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:30.726348 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-cf5355db-32da-4515-ba73-be5dca866d1a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:30.740088 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-cf5355db-32da-4515-ba73-be5dca866d1a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1298 microversion: 2.1 time: 0.231486 Jul 20 08:26:30.741023 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 47/94] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:30 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1298 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:30.748918 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d04b88bd-9b04-4a14-bfdb-b93833c9cc8e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:30.751223 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d04b88bd-9b04-4a14-bfdb-b93833c9cc8e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:30.761164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d04b88bd-9b04-4a14-bfdb-b93833c9cc8e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:30.761907 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d04b88bd-9b04-4a14-bfdb-b93833c9cc8e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:30.763317 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d04b88bd-9b04-4a14-bfdb-b93833c9cc8e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:30.764247 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d04b88bd-9b04-4a14-bfdb-b93833c9cc8e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:30.824932 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-0a61fee7-5673-4b33-b111-373d72607393 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:30.840181 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0a61fee7-5673-4b33-b111-373d72607393 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1272 microversion: 2.1 time: 0.233720 Jul 20 08:26:30.841726 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 48/95] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:30 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1272 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:30.973154 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-8cf83c60-974f-4bf8-b61a-665cdc30a32f req-956a2165-6f27-4544-bb26-c9ae5328fdea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21b295e0-508c-4cd5-b18f-3b808c0ff265", "tag": "25187f6d-a614-4168-94dd-d0c397aaf6f3"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:26:30.982126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-8cf83c60-974f-4bf8-b61a-665cdc30a32f req-956a2165-6f27-4544-bb26-c9ae5328fdea service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:30.982559 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-8cf83c60-974f-4bf8-b61a-665cdc30a32f req-956a2165-6f27-4544-bb26-c9ae5328fdea service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:30.996033 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-8cf83c60-974f-4bf8-b61a-665cdc30a32f req-956a2165-6f27-4544-bb26-c9ae5328fdea service nova] Creating event network-changed:25187f6d-a614-4168-94dd-d0c397aaf6f3 for instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 on hv-cinder-82308 Jul 20 08:26:31.011569 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-8cf83c60-974f-4bf8-b61a-665cdc30a32f req-956a2165-6f27-4544-bb26-c9ae5328fdea service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137655 Jul 20 08:26:31.012266 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 49/96] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:26:31.138537 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d04b88bd-9b04-4a14-bfdb-b93833c9cc8e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:31.155864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d04b88bd-9b04-4a14-bfdb-b93833c9cc8e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:31.160414 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d04b88bd-9b04-4a14-bfdb-b93833c9cc8e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:31.163138 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d04b88bd-9b04-4a14-bfdb-b93833c9cc8e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.420117 Jul 20 08:26:31.179679 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 48/97] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:30 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:31.538670 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-945fd79e-cfea-4cdc-b6b6-0face540cff1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:31.539980 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-945fd79e-cfea-4cdc-b6b6-0face540cff1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:31.558488 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-945fd79e-cfea-4cdc-b6b6-0face540cff1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:31.559426 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-945fd79e-cfea-4cdc-b6b6-0face540cff1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:31.560922 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-945fd79e-cfea-4cdc-b6b6-0face540cff1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:31.561776 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-945fd79e-cfea-4cdc-b6b6-0face540cff1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:31.622117 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-89a67868-06ec-4772-ad95-f68e5fb5d5a6 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:31.623026 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-89a67868-06ec-4772-ad95-f68e5fb5d5a6 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:31.631938 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-89a67868-06ec-4772-ad95-f68e5fb5d5a6 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:31.632382 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-89a67868-06ec-4772-ad95-f68e5fb5d5a6 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:31.633340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-89a67868-06ec-4772-ad95-f68e5fb5d5a6 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:31.633780 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-89a67868-06ec-4772-ad95-f68e5fb5d5a6 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:31.740482 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-89a67868-06ec-4772-ad95-f68e5fb5d5a6 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:31.756203 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-89a67868-06ec-4772-ad95-f68e5fb5d5a6 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1289 microversion: 2.1 time: 0.137692 Jul 20 08:26:31.758022 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 49/98] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:31 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1289 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:31.762443 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-945fd79e-cfea-4cdc-b6b6-0face540cff1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:31.765268 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-00d5d941-dfb0-468e-8739-09913adf35b1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:31.766432 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-00d5d941-dfb0-468e-8739-09913adf35b1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:31.773905 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-00d5d941-dfb0-468e-8739-09913adf35b1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:31.774352 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-00d5d941-dfb0-468e-8739-09913adf35b1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:31.775168 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-00d5d941-dfb0-468e-8739-09913adf35b1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:31.775607 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-00d5d941-dfb0-468e-8739-09913adf35b1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:31.776820 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-945fd79e-cfea-4cdc-b6b6-0face540cff1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.248659 Jul 20 08:26:31.778094 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 50/99] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:31 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:31.860985 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-54350480-527b-4b9a-ad36-4b7b5611607d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:31.861755 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-54350480-527b-4b9a-ad36-4b7b5611607d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:31.870064 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-54350480-527b-4b9a-ad36-4b7b5611607d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:31.870702 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-54350480-527b-4b9a-ad36-4b7b5611607d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:31.871681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-54350480-527b-4b9a-ad36-4b7b5611607d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:31.872249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-54350480-527b-4b9a-ad36-4b7b5611607d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:31.988861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-00d5d941-dfb0-468e-8739-09913adf35b1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:31.998439 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-00d5d941-dfb0-468e-8739-09913adf35b1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.238151 Jul 20 08:26:32.011701 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 50/100] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:31 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:32.051647 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-54350480-527b-4b9a-ad36-4b7b5611607d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:32.059770 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-54350480-527b-4b9a-ad36-4b7b5611607d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.203866 Jul 20 08:26:32.060430 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 51/101] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:31 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:32.192549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-0241ce62-7d16-49c2-9477-3010c229104c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:32.193120 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-0241ce62-7d16-49c2-9477-3010c229104c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:32.199762 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0241ce62-7d16-49c2-9477-3010c229104c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:32.200214 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0241ce62-7d16-49c2-9477-3010c229104c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:32.201159 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0241ce62-7d16-49c2-9477-3010c229104c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:32.201602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0241ce62-7d16-49c2-9477-3010c229104c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:32.351351 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0241ce62-7d16-49c2-9477-3010c229104c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:32.360315 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0241ce62-7d16-49c2-9477-3010c229104c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:32.361875 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0241ce62-7d16-49c2-9477-3010c229104c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:32.363065 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-0241ce62-7d16-49c2-9477-3010c229104c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.175243 Jul 20 08:26:32.363640 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 51/102] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:32 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:26:32.774996 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e8a88dc6-673a-4acd-a35f-2465222b6702 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:32.775809 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-e8a88dc6-673a-4acd-a35f-2465222b6702 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:32.782310 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e8a88dc6-673a-4acd-a35f-2465222b6702 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:32.782798 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e8a88dc6-673a-4acd-a35f-2465222b6702 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:32.783626 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e8a88dc6-673a-4acd-a35f-2465222b6702 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:32.784071 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e8a88dc6-673a-4acd-a35f-2465222b6702 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:32.803201 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ce0b20af-5199-42ab-b5d5-8a9a09773e72 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:32.803962 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ce0b20af-5199-42ab-b5d5-8a9a09773e72 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:32.811295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ce0b20af-5199-42ab-b5d5-8a9a09773e72 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:32.811940 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ce0b20af-5199-42ab-b5d5-8a9a09773e72 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:32.813668 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ce0b20af-5199-42ab-b5d5-8a9a09773e72 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:32.814165 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ce0b20af-5199-42ab-b5d5-8a9a09773e72 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:32.817327 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:32.876099 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e8a88dc6-673a-4acd-a35f-2465222b6702 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:32.888713 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e8a88dc6-673a-4acd-a35f-2465222b6702 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1289 microversion: 2.1 time: 0.117441 Jul 20 08:26:32.889822 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 52/103] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:32 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1289 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:33.007226 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ce0b20af-5199-42ab-b5d5-8a9a09773e72 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:33.017117 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ce0b20af-5199-42ab-b5d5-8a9a09773e72 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.217649 Jul 20 08:26:33.026770 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 52/104] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:32 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:33.027638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f56a67ef-211f-480c-9774-3a4b34172790 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:33.027638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f56a67ef-211f-480c-9774-3a4b34172790 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:33.032323 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f56a67ef-211f-480c-9774-3a4b34172790 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:33.032831 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f56a67ef-211f-480c-9774-3a4b34172790 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:33.033541 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f56a67ef-211f-480c-9774-3a4b34172790 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:33.033973 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f56a67ef-211f-480c-9774-3a4b34172790 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:33.082281 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-1dc826e2-3950-46ff-828f-ba1978929dfd tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:33.083437 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-1dc826e2-3950-46ff-828f-ba1978929dfd tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:33.093027 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1dc826e2-3950-46ff-828f-ba1978929dfd tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:33.093833 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1dc826e2-3950-46ff-828f-ba1978929dfd tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:33.095311 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1dc826e2-3950-46ff-828f-ba1978929dfd tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:33.096102 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1dc826e2-3950-46ff-828f-ba1978929dfd tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:33.223178 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f56a67ef-211f-480c-9774-3a4b34172790 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:33.231686 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f56a67ef-211f-480c-9774-3a4b34172790 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.211432 Jul 20 08:26:33.232302 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 53/105] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:33 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:33.285367 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1dc826e2-3950-46ff-828f-ba1978929dfd tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:33.294902 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-1dc826e2-3950-46ff-828f-ba1978929dfd tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.220653 Jul 20 08:26:33.295648 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 53/106] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:33 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:33.381915 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5905f23f-3372-483f-acc9-503f8fcaa055 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:33.382994 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-5905f23f-3372-483f-acc9-503f8fcaa055 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:33.389698 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5905f23f-3372-483f-acc9-503f8fcaa055 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:33.390281 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5905f23f-3372-483f-acc9-503f8fcaa055 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:33.391662 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5905f23f-3372-483f-acc9-503f8fcaa055 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:33.392163 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5905f23f-3372-483f-acc9-503f8fcaa055 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:33.550736 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5905f23f-3372-483f-acc9-503f8fcaa055 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:33.560232 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5905f23f-3372-483f-acc9-503f8fcaa055 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:33.562323 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5905f23f-3372-483f-acc9-503f8fcaa055 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:33.564436 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-5905f23f-3372-483f-acc9-503f8fcaa055 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.186725 Jul 20 08:26:33.565242 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 54/107] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:33 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:33.915775 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6bcdaffe-57ba-40b5-9119-943799e64045 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:33.916543 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6bcdaffe-57ba-40b5-9119-943799e64045 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:33.924194 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6bcdaffe-57ba-40b5-9119-943799e64045 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:33.924640 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6bcdaffe-57ba-40b5-9119-943799e64045 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:33.925425 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6bcdaffe-57ba-40b5-9119-943799e64045 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:33.925860 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6bcdaffe-57ba-40b5-9119-943799e64045 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:33.993825 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6bcdaffe-57ba-40b5-9119-943799e64045 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:34.002350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6bcdaffe-57ba-40b5-9119-943799e64045 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1289 microversion: 2.1 time: 0.091143 Jul 20 08:26:34.002999 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 54/108] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:33 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1289 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:34.050043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1f221f14-d749-49f3-bf7d-aa9e0e60c8fb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:34.051196 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1f221f14-d749-49f3-bf7d-aa9e0e60c8fb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:34.054557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=8 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:34.061770 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1f221f14-d749-49f3-bf7d-aa9e0e60c8fb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:34.062208 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1f221f14-d749-49f3-bf7d-aa9e0e60c8fb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:34.063197 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1f221f14-d749-49f3-bf7d-aa9e0e60c8fb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:34.063634 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1f221f14-d749-49f3-bf7d-aa9e0e60c8fb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:34.209638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1f221f14-d749-49f3-bf7d-aa9e0e60c8fb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:34.218113 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1f221f14-d749-49f3-bf7d-aa9e0e60c8fb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.175364 Jul 20 08:26:34.218745 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 55/109] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:34 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:34.256458 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a7698c16-fce0-4f32-8c54-1e2ee28f1820 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:34.257066 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a7698c16-fce0-4f32-8c54-1e2ee28f1820 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:34.263646 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a7698c16-fce0-4f32-8c54-1e2ee28f1820 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:34.264089 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a7698c16-fce0-4f32-8c54-1e2ee28f1820 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:34.264855 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a7698c16-fce0-4f32-8c54-1e2ee28f1820 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:34.265290 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a7698c16-fce0-4f32-8c54-1e2ee28f1820 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:34.312500 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-2f56679b-23b0-44e5-827f-05908e7a1678 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:34.313138 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-2f56679b-23b0-44e5-827f-05908e7a1678 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:34.320480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2f56679b-23b0-44e5-827f-05908e7a1678 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:34.320926 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2f56679b-23b0-44e5-827f-05908e7a1678 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:34.321718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2f56679b-23b0-44e5-827f-05908e7a1678 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:34.322150 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2f56679b-23b0-44e5-827f-05908e7a1678 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:34.476619 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2f56679b-23b0-44e5-827f-05908e7a1678 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:34.479650 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a7698c16-fce0-4f32-8c54-1e2ee28f1820 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:34.489255 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-2f56679b-23b0-44e5-827f-05908e7a1678 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.180456 Jul 20 08:26:34.489547 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a7698c16-fce0-4f32-8c54-1e2ee28f1820 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.236764 Jul 20 08:26:34.489966 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 55/110] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:34 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:34.490322 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 56/111] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:34 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:34.586646 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3e6009b3-b178-4fd0-8710-3e11bf458ca2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:34.587312 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3e6009b3-b178-4fd0-8710-3e11bf458ca2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:34.594822 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3e6009b3-b178-4fd0-8710-3e11bf458ca2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:34.595301 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3e6009b3-b178-4fd0-8710-3e11bf458ca2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:34.596135 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3e6009b3-b178-4fd0-8710-3e11bf458ca2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:34.596573 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3e6009b3-b178-4fd0-8710-3e11bf458ca2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:34.754702 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3e6009b3-b178-4fd0-8710-3e11bf458ca2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:34.763479 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3e6009b3-b178-4fd0-8710-3e11bf458ca2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:34.764974 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3e6009b3-b178-4fd0-8710-3e11bf458ca2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:34.766666 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3e6009b3-b178-4fd0-8710-3e11bf458ca2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.184297 Jul 20 08:26:34.767435 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 56/112] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:34 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:26:35.021467 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-16b83efc-8e12-47af-9454-356710a0aeee tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:35.022256 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-16b83efc-8e12-47af-9454-356710a0aeee tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:35.029079 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-16b83efc-8e12-47af-9454-356710a0aeee tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:35.029526 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-16b83efc-8e12-47af-9454-356710a0aeee tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:35.030364 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-16b83efc-8e12-47af-9454-356710a0aeee tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:35.030808 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-16b83efc-8e12-47af-9454-356710a0aeee tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:35.101528 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-16b83efc-8e12-47af-9454-356710a0aeee tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:35.116081 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-16b83efc-8e12-47af-9454-356710a0aeee tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1289 microversion: 2.1 time: 0.099698 Jul 20 08:26:35.117137 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 57/113] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:35 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1289 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:35.244931 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-dad77498-1c54-43b9-b984-388c62e450ee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:35.245534 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-dad77498-1c54-43b9-b984-388c62e450ee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:35.253114 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-dad77498-1c54-43b9-b984-388c62e450ee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:35.253565 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-dad77498-1c54-43b9-b984-388c62e450ee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:35.254361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-dad77498-1c54-43b9-b984-388c62e450ee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:35.254829 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-dad77498-1c54-43b9-b984-388c62e450ee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:35.431330 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-dad77498-1c54-43b9-b984-388c62e450ee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:35.440332 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-dad77498-1c54-43b9-b984-388c62e450ee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.199726 Jul 20 08:26:35.440960 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 57/114] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:35 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:35.512322 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-2a18183a-4d7a-4c87-89ff-45229c52bf6d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:35.512872 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-14947517-5830-4113-8b72-102ee779928e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:35.513624 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-2a18183a-4d7a-4c87-89ff-45229c52bf6d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:35.513790 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-14947517-5830-4113-8b72-102ee779928e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:35.520518 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2a18183a-4d7a-4c87-89ff-45229c52bf6d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:35.521031 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2a18183a-4d7a-4c87-89ff-45229c52bf6d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:35.521990 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2a18183a-4d7a-4c87-89ff-45229c52bf6d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:35.522462 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2a18183a-4d7a-4c87-89ff-45229c52bf6d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:35.524014 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-14947517-5830-4113-8b72-102ee779928e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:35.524813 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-14947517-5830-4113-8b72-102ee779928e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:35.526115 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-14947517-5830-4113-8b72-102ee779928e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:35.526955 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-14947517-5830-4113-8b72-102ee779928e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:35.703648 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2a18183a-4d7a-4c87-89ff-45229c52bf6d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:35.714261 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-2a18183a-4d7a-4c87-89ff-45229c52bf6d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.206059 Jul 20 08:26:35.715223 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 58/115] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:35 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:35.764081 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-14947517-5830-4113-8b72-102ee779928e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:35.784911 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-14947517-5830-4113-8b72-102ee779928e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.276075 Jul 20 08:26:35.795162 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 58/116] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:35 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:35.799673 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-42daa454-617b-4f3f-9b7f-81a9e3150c64 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:35.799673 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-42daa454-617b-4f3f-9b7f-81a9e3150c64 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:35.816485 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-42daa454-617b-4f3f-9b7f-81a9e3150c64 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:35.817004 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-42daa454-617b-4f3f-9b7f-81a9e3150c64 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:35.817951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-42daa454-617b-4f3f-9b7f-81a9e3150c64 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:35.818505 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-42daa454-617b-4f3f-9b7f-81a9e3150c64 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:36.053720 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-42daa454-617b-4f3f-9b7f-81a9e3150c64 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:36.064337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-42daa454-617b-4f3f-9b7f-81a9e3150c64 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:36.066493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-42daa454-617b-4f3f-9b7f-81a9e3150c64 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:36.067734 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-42daa454-617b-4f3f-9b7f-81a9e3150c64 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.277965 Jul 20 08:26:36.068489 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 59/117] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:35 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:36.146744 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-dc70a5e9-7f00-4c72-b6be-5c30a62886e3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:36.147461 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-dc70a5e9-7f00-4c72-b6be-5c30a62886e3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:36.156068 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-dc70a5e9-7f00-4c72-b6be-5c30a62886e3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:36.157524 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-dc70a5e9-7f00-4c72-b6be-5c30a62886e3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:36.161521 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-dc70a5e9-7f00-4c72-b6be-5c30a62886e3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:36.161521 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-dc70a5e9-7f00-4c72-b6be-5c30a62886e3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:36.248658 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-dc70a5e9-7f00-4c72-b6be-5c30a62886e3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:36.259700 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-dc70a5e9-7f00-4c72-b6be-5c30a62886e3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1289 microversion: 2.1 time: 0.119058 Jul 20 08:26:36.260805 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 59/118] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:36 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1289 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:36.461866 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b65028c0-1c67-437f-8283-834bcd33d298 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:36.462458 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b65028c0-1c67-437f-8283-834bcd33d298 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:36.469205 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b65028c0-1c67-437f-8283-834bcd33d298 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:36.469772 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b65028c0-1c67-437f-8283-834bcd33d298 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:36.470704 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b65028c0-1c67-437f-8283-834bcd33d298 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:36.471145 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b65028c0-1c67-437f-8283-834bcd33d298 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:36.679366 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b65028c0-1c67-437f-8283-834bcd33d298 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:36.688655 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b65028c0-1c67-437f-8283-834bcd33d298 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.230230 Jul 20 08:26:36.689337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 60/119] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:36 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:36.733386 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-1cce35c7-4ebb-4014-90f3-7d799235cf33 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:36.734157 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-1cce35c7-4ebb-4014-90f3-7d799235cf33 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:36.741688 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1cce35c7-4ebb-4014-90f3-7d799235cf33 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:36.742290 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1cce35c7-4ebb-4014-90f3-7d799235cf33 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:36.743196 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1cce35c7-4ebb-4014-90f3-7d799235cf33 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:36.743828 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1cce35c7-4ebb-4014-90f3-7d799235cf33 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:36.768598 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=2 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:36.804028 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1761c916-e958-4947-90fe-3cc3d23279ce tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:36.804640 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1761c916-e958-4947-90fe-3cc3d23279ce tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:36.811156 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1761c916-e958-4947-90fe-3cc3d23279ce tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:36.811612 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1761c916-e958-4947-90fe-3cc3d23279ce tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:36.813019 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1761c916-e958-4947-90fe-3cc3d23279ce tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:36.813439 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1761c916-e958-4947-90fe-3cc3d23279ce tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:36.918721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=11 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:36.987916 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1761c916-e958-4947-90fe-3cc3d23279ce tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:37.004402 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1761c916-e958-4947-90fe-3cc3d23279ce tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.204097 Jul 20 08:26:37.005775 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 61/120] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:36 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:37.087034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a25350c5-f64c-4ada-80a7-bfdcf9e3eb41 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:37.087844 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a25350c5-f64c-4ada-80a7-bfdcf9e3eb41 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:37.107581 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a25350c5-f64c-4ada-80a7-bfdcf9e3eb41 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:37.108043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a25350c5-f64c-4ada-80a7-bfdcf9e3eb41 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:37.110856 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1cce35c7-4ebb-4014-90f3-7d799235cf33 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:37.113809 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a25350c5-f64c-4ada-80a7-bfdcf9e3eb41 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:37.114471 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a25350c5-f64c-4ada-80a7-bfdcf9e3eb41 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:37.121411 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-1cce35c7-4ebb-4014-90f3-7d799235cf33 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.392101 Jul 20 08:26:37.135496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 60/121] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:36 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:37.277953 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-aeedf631-950e-409c-9608-99c02ddcba41 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:37.278972 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-aeedf631-950e-409c-9608-99c02ddcba41 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:37.287299 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aeedf631-950e-409c-9608-99c02ddcba41 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:37.288050 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aeedf631-950e-409c-9608-99c02ddcba41 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:37.289010 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aeedf631-950e-409c-9608-99c02ddcba41 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:37.289765 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aeedf631-950e-409c-9608-99c02ddcba41 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:37.368864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-aeedf631-950e-409c-9608-99c02ddcba41 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:37.378152 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-aeedf631-950e-409c-9608-99c02ddcba41 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1289 microversion: 2.1 time: 0.104480 Jul 20 08:26:37.380406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 61/122] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:37 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1289 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:37.423644 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a25350c5-f64c-4ada-80a7-bfdcf9e3eb41 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:37.448791 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a25350c5-f64c-4ada-80a7-bfdcf9e3eb41 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:37.455740 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a25350c5-f64c-4ada-80a7-bfdcf9e3eb41 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:37.461689 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a25350c5-f64c-4ada-80a7-bfdcf9e3eb41 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.377921 Jul 20 08:26:37.467581 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 62/123] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:37 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:26:37.709607 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6f510253-b815-4245-9756-3a4431fa7bc9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:37.710678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6f510253-b815-4245-9756-3a4431fa7bc9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:37.733748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6f510253-b815-4245-9756-3a4431fa7bc9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:37.739163 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6f510253-b815-4245-9756-3a4431fa7bc9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:37.742392 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6f510253-b815-4245-9756-3a4431fa7bc9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:37.743582 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6f510253-b815-4245-9756-3a4431fa7bc9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:38.029111 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1ffe2691-449a-48db-a132-30e6a88f8afc tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:38.030713 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1ffe2691-449a-48db-a132-30e6a88f8afc tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:38.059101 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1ffe2691-449a-48db-a132-30e6a88f8afc tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:38.060476 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1ffe2691-449a-48db-a132-30e6a88f8afc tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:38.062264 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1ffe2691-449a-48db-a132-30e6a88f8afc tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:38.064133 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1ffe2691-449a-48db-a132-30e6a88f8afc tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:38.072547 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=100 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:38.367078 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6f510253-b815-4245-9756-3a4431fa7bc9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:38.376799 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6f510253-b815-4245-9756-3a4431fa7bc9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.674412 Jul 20 08:26:38.386323 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 62/124] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:37 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:38.392198 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c1479520-565b-43c6-bd4f-7ae94ebfaba0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:38.393466 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c1479520-565b-43c6-bd4f-7ae94ebfaba0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:38.401833 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c1479520-565b-43c6-bd4f-7ae94ebfaba0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:38.402351 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c1479520-565b-43c6-bd4f-7ae94ebfaba0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:38.403461 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c1479520-565b-43c6-bd4f-7ae94ebfaba0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:38.404000 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c1479520-565b-43c6-bd4f-7ae94ebfaba0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:38.690356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1ffe2691-449a-48db-a132-30e6a88f8afc tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:38.742855 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1ffe2691-449a-48db-a132-30e6a88f8afc tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.723646 Jul 20 08:26:38.767150 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c1479520-565b-43c6-bd4f-7ae94ebfaba0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:38.776508 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c1479520-565b-43c6-bd4f-7ae94ebfaba0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.388629 Jul 20 08:26:38.782177 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 63/125] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:38 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:38.782735 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 63/126] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:38 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:38.798960 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6d24a0f4-5af7-4b45-869e-894228da2169 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:38.799861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6d24a0f4-5af7-4b45-869e-894228da2169 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:38.804622 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e6d246b5-a88a-4286-a095-898bfae2cbcb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:38.806808 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6d24a0f4-5af7-4b45-869e-894228da2169 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:38.807596 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6d24a0f4-5af7-4b45-869e-894228da2169 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:38.807771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-e6d246b5-a88a-4286-a095-898bfae2cbcb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:38.808751 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6d24a0f4-5af7-4b45-869e-894228da2169 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:38.809431 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6d24a0f4-5af7-4b45-869e-894228da2169 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:38.825090 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e6d246b5-a88a-4286-a095-898bfae2cbcb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:38.825617 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e6d246b5-a88a-4286-a095-898bfae2cbcb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:38.826485 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e6d246b5-a88a-4286-a095-898bfae2cbcb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:38.827019 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e6d246b5-a88a-4286-a095-898bfae2cbcb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:39.044320 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e6d246b5-a88a-4286-a095-898bfae2cbcb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:39.064882 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e6d246b5-a88a-4286-a095-898bfae2cbcb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1307 microversion: 2.1 time: 0.279605 Jul 20 08:26:39.065736 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 64/127] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:38 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1307 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:39.390662 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=16 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:39.400131 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-6bc79e49-9178-445a-ae12-bcfcceda88bc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:39.401128 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-6bc79e49-9178-445a-ae12-bcfcceda88bc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:39.415524 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6bc79e49-9178-445a-ae12-bcfcceda88bc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:39.417727 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6bc79e49-9178-445a-ae12-bcfcceda88bc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:39.419494 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6bc79e49-9178-445a-ae12-bcfcceda88bc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:39.422439 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6bc79e49-9178-445a-ae12-bcfcceda88bc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:39.787378 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6d24a0f4-5af7-4b45-869e-894228da2169 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:39.821542 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6d24a0f4-5af7-4b45-869e-894228da2169 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:39.825150 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6d24a0f4-5af7-4b45-869e-894228da2169 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:39.834043 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6d24a0f4-5af7-4b45-869e-894228da2169 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 1.039070 Jul 20 08:26:39.835316 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 64/128] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:38 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:39.958869 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-e64de6a5-48fa-4315-baea-816b51834766 req-50bf13c8-5345-4527-9251-30252d04e140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff2ea553-bf93-4f6e-b624-935ecec595b7", "name": "network-vif-plugged", "status": "completed", "tag": "06458427-d317-4965-817d-8affbd2750e5"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:26:39.983571 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-e64de6a5-48fa-4315-baea-816b51834766 req-50bf13c8-5345-4527-9251-30252d04e140 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:39.988927 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-e64de6a5-48fa-4315-baea-816b51834766 req-50bf13c8-5345-4527-9251-30252d04e140 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:40.035973 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-e64de6a5-48fa-4315-baea-816b51834766 req-50bf13c8-5345-4527-9251-30252d04e140 service nova] Creating event network-vif-plugged:06458427-d317-4965-817d-8affbd2750e5 for instance ff2ea553-bf93-4f6e-b624-935ecec595b7 on hv-cinder-82308 Jul 20 08:26:40.059910 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-e64de6a5-48fa-4315-baea-816b51834766 req-50bf13c8-5345-4527-9251-30252d04e140 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221831 Jul 20 08:26:40.061376 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 65/129] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:26:40.084263 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3220cfdd-df1f-4895-b5ad-53085896c5d5 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:40.086059 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3220cfdd-df1f-4895-b5ad-53085896c5d5 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:40.103968 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3220cfdd-df1f-4895-b5ad-53085896c5d5 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:40.106085 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3220cfdd-df1f-4895-b5ad-53085896c5d5 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:40.107637 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3220cfdd-df1f-4895-b5ad-53085896c5d5 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:40.108416 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3220cfdd-df1f-4895-b5ad-53085896c5d5 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:40.135199 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-6bc79e49-9178-445a-ae12-bcfcceda88bc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:40.146083 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-6bc79e49-9178-445a-ae12-bcfcceda88bc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.755707 Jul 20 08:26:40.146800 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 65/130] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:39 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:40.158870 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-6fc8b97b-3e3f-4f18-bf66-1abea2bd9f4c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:40.159281 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-6fc8b97b-3e3f-4f18-bf66-1abea2bd9f4c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:40.169941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6fc8b97b-3e3f-4f18-bf66-1abea2bd9f4c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:40.170799 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6fc8b97b-3e3f-4f18-bf66-1abea2bd9f4c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:40.171749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6fc8b97b-3e3f-4f18-bf66-1abea2bd9f4c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:40.172824 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6fc8b97b-3e3f-4f18-bf66-1abea2bd9f4c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:40.380053 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3220cfdd-df1f-4895-b5ad-53085896c5d5 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:40.392603 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3220cfdd-df1f-4895-b5ad-53085896c5d5 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.325722 Jul 20 08:26:40.397875 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 66/131] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:40 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:40.403075 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-1a8cabdb-7421-4969-b97a-5b72b87da949 req-1a512221-a41c-4fcd-b807-27df1eac6020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0df430-d3f8-4e9d-949f-5d8f0359484d", "tag": "1a663922-bde3-4ffe-a3dd-70862157632c"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:26:40.425366 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-1a8cabdb-7421-4969-b97a-5b72b87da949 req-1a512221-a41c-4fcd-b807-27df1eac6020 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:40.426087 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-1a8cabdb-7421-4969-b97a-5b72b87da949 req-1a512221-a41c-4fcd-b807-27df1eac6020 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:40.431578 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-6fc8b97b-3e3f-4f18-bf66-1abea2bd9f4c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:40.446094 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-6fc8b97b-3e3f-4f18-bf66-1abea2bd9f4c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.298130 Jul 20 08:26:40.448279 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 66/132] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:40 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:40.458126 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-1a8cabdb-7421-4969-b97a-5b72b87da949 req-1a512221-a41c-4fcd-b807-27df1eac6020 service nova] Creating event network-changed:1a663922-bde3-4ffe-a3dd-70862157632c for instance fa0df430-d3f8-4e9d-949f-5d8f0359484d on hv-cinder-82308 Jul 20 08:26:40.466340 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a49a82ac-2161-473e-a83d-76ed9f1a9bca tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:40.467056 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a49a82ac-2161-473e-a83d-76ed9f1a9bca tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:40.471648 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-1a8cabdb-7421-4969-b97a-5b72b87da949 req-1a512221-a41c-4fcd-b807-27df1eac6020 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072030 Jul 20 08:26:40.472582 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 67/133] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:26:40.480989 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-97a947e4-6468-44c3-90e1-3d8bd190ab73 req-dd00bf32-d7f4-485a-85ae-4ebbaf975e89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659d1d17-9163-4971-9ba1-40f3f20d2650", "tag": "e37caaf1-6167-4ebe-94cd-55ea929f139d"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:26:40.492479 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a49a82ac-2161-473e-a83d-76ed9f1a9bca tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:40.493824 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a49a82ac-2161-473e-a83d-76ed9f1a9bca tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:40.495550 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-97a947e4-6468-44c3-90e1-3d8bd190ab73 req-dd00bf32-d7f4-485a-85ae-4ebbaf975e89 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:40.496012 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a49a82ac-2161-473e-a83d-76ed9f1a9bca tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:40.496881 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a49a82ac-2161-473e-a83d-76ed9f1a9bca tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:40.497496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-97a947e4-6468-44c3-90e1-3d8bd190ab73 req-dd00bf32-d7f4-485a-85ae-4ebbaf975e89 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:40.525272 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-97a947e4-6468-44c3-90e1-3d8bd190ab73 req-dd00bf32-d7f4-485a-85ae-4ebbaf975e89 service nova] Creating event network-changed:e37caaf1-6167-4ebe-94cd-55ea929f139d for instance 659d1d17-9163-4971-9ba1-40f3f20d2650 on hv-cinder-82308 Jul 20 08:26:40.536533 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-97a947e4-6468-44c3-90e1-3d8bd190ab73 req-dd00bf32-d7f4-485a-85ae-4ebbaf975e89 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058607 Jul 20 08:26:40.537180 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 68/134] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:26:40.586921 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a49a82ac-2161-473e-a83d-76ed9f1a9bca tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:40.596359 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a49a82ac-2161-473e-a83d-76ed9f1a9bca tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1295 microversion: 2.1 time: 0.146313 Jul 20 08:26:40.598741 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 67/135] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:40 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1295 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:40.856391 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-0f54fa47-39cd-4a6b-be0a-d52eabb8179f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:40.857223 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-0f54fa47-39cd-4a6b-be0a-d52eabb8179f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:40.870430 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:40.872685 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0f54fa47-39cd-4a6b-be0a-d52eabb8179f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:40.873766 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0f54fa47-39cd-4a6b-be0a-d52eabb8179f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:40.875959 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0f54fa47-39cd-4a6b-be0a-d52eabb8179f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:40.877030 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0f54fa47-39cd-4a6b-be0a-d52eabb8179f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:41.123776 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0f54fa47-39cd-4a6b-be0a-d52eabb8179f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:41.138876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0f54fa47-39cd-4a6b-be0a-d52eabb8179f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:41.140908 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0f54fa47-39cd-4a6b-be0a-d52eabb8179f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:41.142545 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-0f54fa47-39cd-4a6b-be0a-d52eabb8179f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.291860 Jul 20 08:26:41.143552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 69/136] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:40 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:41.175547 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5ead5575-99af-4892-ae59-40d94317f9ba tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:41.176300 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-5ead5575-99af-4892-ae59-40d94317f9ba tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:41.182649 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:41.184631 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5ead5575-99af-4892-ae59-40d94317f9ba tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:41.185371 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5ead5575-99af-4892-ae59-40d94317f9ba tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:41.186603 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5ead5575-99af-4892-ae59-40d94317f9ba tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:41.187252 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5ead5575-99af-4892-ae59-40d94317f9ba tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:41.419305 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8f98e577-8417-47e1-8975-87de30d65163 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:41.420633 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8f98e577-8417-47e1-8975-87de30d65163 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:41.432959 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8f98e577-8417-47e1-8975-87de30d65163 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:41.442258 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8f98e577-8417-47e1-8975-87de30d65163 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:41.446944 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5ead5575-99af-4892-ae59-40d94317f9ba tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:41.452679 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8f98e577-8417-47e1-8975-87de30d65163 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:41.453188 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8f98e577-8417-47e1-8975-87de30d65163 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:41.461299 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-5ead5575-99af-4892-ae59-40d94317f9ba tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.290500 Jul 20 08:26:41.478341 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 68/137] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:41 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:41.483260 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-82db037b-ff16-48e0-9b18-cc0d5f032f74 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:41.483260 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-82db037b-ff16-48e0-9b18-cc0d5f032f74 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:41.494944 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-82db037b-ff16-48e0-9b18-cc0d5f032f74 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:41.496003 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-82db037b-ff16-48e0-9b18-cc0d5f032f74 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:41.496831 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-82db037b-ff16-48e0-9b18-cc0d5f032f74 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:41.497407 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-82db037b-ff16-48e0-9b18-cc0d5f032f74 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:41.724948 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-82db037b-ff16-48e0-9b18-cc0d5f032f74 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:41.742036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-82db037b-ff16-48e0-9b18-cc0d5f032f74 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.271333 Jul 20 08:26:41.743192 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 69/138] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:41 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:41.753443 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-2f38f83a-1899-4321-8d21-b01db64f3d48 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:41.755284 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-2f38f83a-1899-4321-8d21-b01db64f3d48 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:41.767662 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2f38f83a-1899-4321-8d21-b01db64f3d48 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:41.768668 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2f38f83a-1899-4321-8d21-b01db64f3d48 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:41.770712 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2f38f83a-1899-4321-8d21-b01db64f3d48 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:41.771799 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2f38f83a-1899-4321-8d21-b01db64f3d48 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:41.945798 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2f38f83a-1899-4321-8d21-b01db64f3d48 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:41.963023 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-2f38f83a-1899-4321-8d21-b01db64f3d48 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1295 microversion: 2.1 time: 0.217559 Jul 20 08:26:41.964761 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 70/139] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:41 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1295 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:42.168127 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c84419d0-2f60-4bf6-a865-f1cdc0fe78c3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:42.171501 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8f98e577-8417-47e1-8975-87de30d65163 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:42.174558 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c84419d0-2f60-4bf6-a865-f1cdc0fe78c3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:42.178156 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:42.201752 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c84419d0-2f60-4bf6-a865-f1cdc0fe78c3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:42.207666 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c84419d0-2f60-4bf6-a865-f1cdc0fe78c3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:42.209602 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c84419d0-2f60-4bf6-a865-f1cdc0fe78c3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:42.212908 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c84419d0-2f60-4bf6-a865-f1cdc0fe78c3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:42.225125 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8f98e577-8417-47e1-8975-87de30d65163 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.810108 Jul 20 08:26:42.230614 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 70/140] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:41 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:42.495452 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-bf373608-a689-4756-87e0-8bfcd739bc2c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:42.496733 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-bf373608-a689-4756-87e0-8bfcd739bc2c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:42.517482 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bf373608-a689-4756-87e0-8bfcd739bc2c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:42.518261 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bf373608-a689-4756-87e0-8bfcd739bc2c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:42.519706 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bf373608-a689-4756-87e0-8bfcd739bc2c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:42.532408 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bf373608-a689-4756-87e0-8bfcd739bc2c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:42.892034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c84419d0-2f60-4bf6-a865-f1cdc0fe78c3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:42.901583 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c84419d0-2f60-4bf6-a865-f1cdc0fe78c3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:42.903659 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c84419d0-2f60-4bf6-a865-f1cdc0fe78c3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:42.905145 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c84419d0-2f60-4bf6-a865-f1cdc0fe78c3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.746918 Jul 20 08:26:42.907243 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 71/141] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:42 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:42.912783 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e9d7854c-1cd1-400c-8c0d-582c62541a00 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:42.913721 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-e9d7854c-1cd1-400c-8c0d-582c62541a00 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:42.921606 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e9d7854c-1cd1-400c-8c0d-582c62541a00 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:42.922907 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e9d7854c-1cd1-400c-8c0d-582c62541a00 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:42.923955 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e9d7854c-1cd1-400c-8c0d-582c62541a00 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:42.924689 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e9d7854c-1cd1-400c-8c0d-582c62541a00 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:43.389701 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-bf373608-a689-4756-87e0-8bfcd739bc2c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:43.402371 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-bf373608-a689-4756-87e0-8bfcd739bc2c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.914040 Jul 20 08:26:43.416194 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 71/142] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:42 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:43.421542 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-71181be5-45f4-4688-95c1-e3fb43f9d533 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:43.424535 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-71181be5-45f4-4688-95c1-e3fb43f9d533 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:43.440711 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-71181be5-45f4-4688-95c1-e3fb43f9d533 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:43.441954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-71181be5-45f4-4688-95c1-e3fb43f9d533 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:43.447578 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-71181be5-45f4-4688-95c1-e3fb43f9d533 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:43.448122 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-71181be5-45f4-4688-95c1-e3fb43f9d533 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:43.485858 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e9d7854c-1cd1-400c-8c0d-582c62541a00 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:43.495279 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e9d7854c-1cd1-400c-8c0d-582c62541a00 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.585613 Jul 20 08:26:43.495873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 72/143] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:42 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:43.501368 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9561f1a8-8402-42eb-86ff-49b5ba44de3c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:43.502249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9561f1a8-8402-42eb-86ff-49b5ba44de3c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:43.513792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9561f1a8-8402-42eb-86ff-49b5ba44de3c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:43.514690 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9561f1a8-8402-42eb-86ff-49b5ba44de3c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:43.516088 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9561f1a8-8402-42eb-86ff-49b5ba44de3c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:43.517041 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9561f1a8-8402-42eb-86ff-49b5ba44de3c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:43.707374 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-71181be5-45f4-4688-95c1-e3fb43f9d533 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:43.729794 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-71181be5-45f4-4688-95c1-e3fb43f9d533 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1295 microversion: 2.1 time: 0.311964 Jul 20 08:26:43.731331 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 72/144] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:43 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1295 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:43.752736 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9561f1a8-8402-42eb-86ff-49b5ba44de3c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:43.794635 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9561f1a8-8402-42eb-86ff-49b5ba44de3c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.297397 Jul 20 08:26:43.795658 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 73/145] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:43 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:43.925812 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-de727458-beda-4114-9647-9b7c6431b11d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:43.926424 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-de727458-beda-4114-9647-9b7c6431b11d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:43.940495 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-de727458-beda-4114-9647-9b7c6431b11d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:43.942681 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-de727458-beda-4114-9647-9b7c6431b11d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:43.945860 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-de727458-beda-4114-9647-9b7c6431b11d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:43.946910 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-de727458-beda-4114-9647-9b7c6431b11d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:44.310977 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-de727458-beda-4114-9647-9b7c6431b11d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:44.326796 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-de727458-beda-4114-9647-9b7c6431b11d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:44.329998 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-de727458-beda-4114-9647-9b7c6431b11d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:44.331989 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-de727458-beda-4114-9647-9b7c6431b11d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.411100 Jul 20 08:26:44.333244 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 73/146] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:43 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:44.425459 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-dedbbff7-e27c-47e4-ab75-9f9c3bfac537 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:44.426307 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-dedbbff7-e27c-47e4-ab75-9f9c3bfac537 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:44.434309 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-dedbbff7-e27c-47e4-ab75-9f9c3bfac537 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:44.434972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-dedbbff7-e27c-47e4-ab75-9f9c3bfac537 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:44.436303 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-dedbbff7-e27c-47e4-ab75-9f9c3bfac537 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:44.436882 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-dedbbff7-e27c-47e4-ab75-9f9c3bfac537 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:44.518437 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d20221fb-9961-433e-b51c-30fb369e5fb4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:44.521624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d20221fb-9961-433e-b51c-30fb369e5fb4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:44.538678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d20221fb-9961-433e-b51c-30fb369e5fb4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:44.539583 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d20221fb-9961-433e-b51c-30fb369e5fb4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:44.541170 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d20221fb-9961-433e-b51c-30fb369e5fb4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:44.542126 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d20221fb-9961-433e-b51c-30fb369e5fb4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:44.619123 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-dedbbff7-e27c-47e4-ab75-9f9c3bfac537 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:44.630294 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-dedbbff7-e27c-47e4-ab75-9f9c3bfac537 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.212931 Jul 20 08:26:44.631404 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 74/147] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:44 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:44.774740 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3b146acd-39de-436d-aebf-e3b0b4999338 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:44.783034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-3b146acd-39de-436d-aebf-e3b0b4999338 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:44.800583 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3b146acd-39de-436d-aebf-e3b0b4999338 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:44.801579 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3b146acd-39de-436d-aebf-e3b0b4999338 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:44.802114 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d20221fb-9961-433e-b51c-30fb369e5fb4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:44.803242 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3b146acd-39de-436d-aebf-e3b0b4999338 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:44.803792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3b146acd-39de-436d-aebf-e3b0b4999338 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:44.815817 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d20221fb-9961-433e-b51c-30fb369e5fb4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.305508 Jul 20 08:26:44.817427 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 74/148] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:44 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:44.823223 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e74a5334-4ffe-4a6b-b13e-b9b1f69e76bf tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:44.824950 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e74a5334-4ffe-4a6b-b13e-b9b1f69e76bf tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:44.834859 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e74a5334-4ffe-4a6b-b13e-b9b1f69e76bf tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:44.835689 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e74a5334-4ffe-4a6b-b13e-b9b1f69e76bf tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:44.836714 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e74a5334-4ffe-4a6b-b13e-b9b1f69e76bf tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:44.837934 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e74a5334-4ffe-4a6b-b13e-b9b1f69e76bf tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:45.110516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3b146acd-39de-436d-aebf-e3b0b4999338 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:45.125708 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-3b146acd-39de-436d-aebf-e3b0b4999338 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.366001 Jul 20 08:26:45.127417 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 75/149] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:44 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:45.207824 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e74a5334-4ffe-4a6b-b13e-b9b1f69e76bf tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:45.221883 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e74a5334-4ffe-4a6b-b13e-b9b1f69e76bf tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.402992 Jul 20 08:26:45.240524 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 75/150] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:44 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:45.359126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-cb1f662c-05ad-4711-8256-17e807d291a3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:45.360887 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-cb1f662c-05ad-4711-8256-17e807d291a3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:45.378607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-cb1f662c-05ad-4711-8256-17e807d291a3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:45.379517 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-cb1f662c-05ad-4711-8256-17e807d291a3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:45.381678 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-cb1f662c-05ad-4711-8256-17e807d291a3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:45.382499 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-cb1f662c-05ad-4711-8256-17e807d291a3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:45.658786 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-752d70e8-b35f-43de-ada1-bccaebe80fc3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:45.661884 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-752d70e8-b35f-43de-ada1-bccaebe80fc3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:45.686572 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-752d70e8-b35f-43de-ada1-bccaebe80fc3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:45.695712 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-752d70e8-b35f-43de-ada1-bccaebe80fc3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:45.697104 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-752d70e8-b35f-43de-ada1-bccaebe80fc3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:45.700198 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-752d70e8-b35f-43de-ada1-bccaebe80fc3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:45.711586 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-cb1f662c-05ad-4711-8256-17e807d291a3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:45.757211 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-cb1f662c-05ad-4711-8256-17e807d291a3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:45.770203 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-cb1f662c-05ad-4711-8256-17e807d291a3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:45.774991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-cb1f662c-05ad-4711-8256-17e807d291a3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.423245 Jul 20 08:26:45.777240 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 76/151] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:45 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:45.848632 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9aacd727-190a-4045-ab93-3ecbdee3cc33 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:45.849350 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9aacd727-190a-4045-ab93-3ecbdee3cc33 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:45.857595 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9aacd727-190a-4045-ab93-3ecbdee3cc33 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:45.858197 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9aacd727-190a-4045-ab93-3ecbdee3cc33 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:45.859973 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9aacd727-190a-4045-ab93-3ecbdee3cc33 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:45.860742 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9aacd727-190a-4045-ab93-3ecbdee3cc33 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:45.893326 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-752d70e8-b35f-43de-ada1-bccaebe80fc3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:45.902078 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-752d70e8-b35f-43de-ada1-bccaebe80fc3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.252004 Jul 20 08:26:45.903904 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 76/152] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:45 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:46.044598 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9aacd727-190a-4045-ab93-3ecbdee3cc33 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:46.053240 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9aacd727-190a-4045-ab93-3ecbdee3cc33 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.209615 Jul 20 08:26:46.053824 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 77/153] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:45 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:46.151001 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8982914c-c386-4081-93da-c172c7b10618 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:46.151723 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8982914c-c386-4081-93da-c172c7b10618 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:46.159115 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8982914c-c386-4081-93da-c172c7b10618 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:46.159814 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8982914c-c386-4081-93da-c172c7b10618 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:46.160639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8982914c-c386-4081-93da-c172c7b10618 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:46.161078 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8982914c-c386-4081-93da-c172c7b10618 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:46.251468 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f7391a4d-f10d-4286-b66a-266dbe082b9e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:46.252421 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f7391a4d-f10d-4286-b66a-266dbe082b9e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:46.262814 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f7391a4d-f10d-4286-b66a-266dbe082b9e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:46.263821 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f7391a4d-f10d-4286-b66a-266dbe082b9e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:46.265495 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f7391a4d-f10d-4286-b66a-266dbe082b9e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:46.266283 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f7391a4d-f10d-4286-b66a-266dbe082b9e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:46.485794 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f7391a4d-f10d-4286-b66a-266dbe082b9e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:46.502365 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f7391a4d-f10d-4286-b66a-266dbe082b9e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.257714 Jul 20 08:26:46.503077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 78/154] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:46 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:46.567744 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8982914c-c386-4081-93da-c172c7b10618 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:46.577342 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8982914c-c386-4081-93da-c172c7b10618 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.430445 Jul 20 08:26:46.580093 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 77/155] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:46 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:46.798543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b07e81ca-5faf-4cf7-9516-84bc3d16b307 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:46.799433 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b07e81ca-5faf-4cf7-9516-84bc3d16b307 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:46.810859 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b07e81ca-5faf-4cf7-9516-84bc3d16b307 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:46.811731 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b07e81ca-5faf-4cf7-9516-84bc3d16b307 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:46.813838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b07e81ca-5faf-4cf7-9516-84bc3d16b307 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:46.814688 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b07e81ca-5faf-4cf7-9516-84bc3d16b307 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:46.923439 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-0a9f3304-7526-47f4-b716-a8b17dbe42d5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:46.924666 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-0a9f3304-7526-47f4-b716-a8b17dbe42d5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:46.948529 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0a9f3304-7526-47f4-b716-a8b17dbe42d5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:46.949345 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0a9f3304-7526-47f4-b716-a8b17dbe42d5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:46.950830 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0a9f3304-7526-47f4-b716-a8b17dbe42d5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:46.951590 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0a9f3304-7526-47f4-b716-a8b17dbe42d5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:47.105499 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b07e81ca-5faf-4cf7-9516-84bc3d16b307 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:47.113446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=100 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:47.133410 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b07e81ca-5faf-4cf7-9516-84bc3d16b307 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:47.150447 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b07e81ca-5faf-4cf7-9516-84bc3d16b307 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:47.159525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b07e81ca-5faf-4cf7-9516-84bc3d16b307 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.359308 Jul 20 08:26:47.164472 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 79/156] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:46 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:26:47.187189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-df713b62-217e-4229-bd7b-dca77f51e5ed tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:47.195641 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-df713b62-217e-4229-bd7b-dca77f51e5ed tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:47.204846 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-df713b62-217e-4229-bd7b-dca77f51e5ed tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:47.205785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-df713b62-217e-4229-bd7b-dca77f51e5ed tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:47.207865 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-df713b62-217e-4229-bd7b-dca77f51e5ed tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:47.208911 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-df713b62-217e-4229-bd7b-dca77f51e5ed tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:47.487205 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-df713b62-217e-4229-bd7b-dca77f51e5ed tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:47.522556 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-df713b62-217e-4229-bd7b-dca77f51e5ed tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.355922 Jul 20 08:26:47.523924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 80/157] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:47 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:47.539646 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-7331f1a6-2c68-4e63-ba62-b5aa44ec4507 req-bce85d90-ae57-414e-b06d-f59eae86a9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a", "name": "network-vif-plugged", "status": "completed", "tag": "7f795798-1661-4ba0-bf5a-641687efe8e3"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:26:47.576042 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-7331f1a6-2c68-4e63-ba62-b5aa44ec4507 req-bce85d90-ae57-414e-b06d-f59eae86a9f5 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:47.581452 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-7331f1a6-2c68-4e63-ba62-b5aa44ec4507 req-bce85d90-ae57-414e-b06d-f59eae86a9f5 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:47.632152 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-7331f1a6-2c68-4e63-ba62-b5aa44ec4507 req-bce85d90-ae57-414e-b06d-f59eae86a9f5 service nova] Creating event network-vif-plugged:7f795798-1661-4ba0-bf5a-641687efe8e3 for instance ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a on hv-cinder-82308 Jul 20 08:26:47.646628 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-7331f1a6-2c68-4e63-ba62-b5aa44ec4507 req-bce85d90-ae57-414e-b06d-f59eae86a9f5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120418 Jul 20 08:26:47.647704 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 81/158] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:26:47.663158 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-78b0f13c-dc0d-4595-9466-dc95f191685d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:47.664584 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-78b0f13c-dc0d-4595-9466-dc95f191685d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:47.682101 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-78b0f13c-dc0d-4595-9466-dc95f191685d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:47.684003 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-78b0f13c-dc0d-4595-9466-dc95f191685d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:47.685283 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-78b0f13c-dc0d-4595-9466-dc95f191685d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:47.685987 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-78b0f13c-dc0d-4595-9466-dc95f191685d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:47.742934 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0a9f3304-7526-47f4-b716-a8b17dbe42d5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:47.753003 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-0a9f3304-7526-47f4-b716-a8b17dbe42d5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.835678 Jul 20 08:26:47.767827 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 78/159] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:46 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:47.773708 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3eb8a0b0-f4f1-489b-ae1c-ee61cb359aef tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:47.775876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3eb8a0b0-f4f1-489b-ae1c-ee61cb359aef tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:47.792711 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3eb8a0b0-f4f1-489b-ae1c-ee61cb359aef tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:47.793170 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3eb8a0b0-f4f1-489b-ae1c-ee61cb359aef tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:47.798264 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3eb8a0b0-f4f1-489b-ae1c-ee61cb359aef tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:47.798958 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3eb8a0b0-f4f1-489b-ae1c-ee61cb359aef tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:48.160280 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-78b0f13c-dc0d-4595-9466-dc95f191685d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:48.192135 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-78b0f13c-dc0d-4595-9466-dc95f191685d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.537771 Jul 20 08:26:48.194111 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 82/160] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:47 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:48.209584 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ff5c3825-4304-4aaf-b146-5110bba3bcad tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:48.225376 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ff5c3825-4304-4aaf-b146-5110bba3bcad tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:48.267484 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ff5c3825-4304-4aaf-b146-5110bba3bcad tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:48.268403 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ff5c3825-4304-4aaf-b146-5110bba3bcad tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:48.270080 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ff5c3825-4304-4aaf-b146-5110bba3bcad tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:48.278941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ff5c3825-4304-4aaf-b146-5110bba3bcad tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:48.507152 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3eb8a0b0-f4f1-489b-ae1c-ee61cb359aef tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:48.554028 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3eb8a0b0-f4f1-489b-ae1c-ee61cb359aef tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.782048 Jul 20 08:26:48.556717 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 79/161] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:47 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:48.578076 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-59eff562-78fc-400d-9009-20c8e53a3c79 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:48.582036 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-59eff562-78fc-400d-9009-20c8e53a3c79 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:48.611702 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-59eff562-78fc-400d-9009-20c8e53a3c79 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:48.616836 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-59eff562-78fc-400d-9009-20c8e53a3c79 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:48.623956 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-59eff562-78fc-400d-9009-20c8e53a3c79 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:48.625026 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-59eff562-78fc-400d-9009-20c8e53a3c79 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:48.679092 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ff5c3825-4304-4aaf-b146-5110bba3bcad tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:48.697361 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ff5c3825-4304-4aaf-b146-5110bba3bcad tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:48.706811 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ff5c3825-4304-4aaf-b146-5110bba3bcad tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:48.715815 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ff5c3825-4304-4aaf-b146-5110bba3bcad tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.519937 Jul 20 08:26:48.717282 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 83/162] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:48 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:48.731851 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-1eb1dfc0-386a-4ecc-a850-74b57ff70094 req-09b03565-c758-41bc-88ed-8d74ac5a7057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c374291c-87f7-45dd-9391-807207d937bc", "tag": "90d4b267-6b9e-479b-978c-9e4434caa2b0"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:26:48.757409 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-1eb1dfc0-386a-4ecc-a850-74b57ff70094 req-09b03565-c758-41bc-88ed-8d74ac5a7057 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:48.757941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-1eb1dfc0-386a-4ecc-a850-74b57ff70094 req-09b03565-c758-41bc-88ed-8d74ac5a7057 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:48.774019 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-1eb1dfc0-386a-4ecc-a850-74b57ff70094 req-09b03565-c758-41bc-88ed-8d74ac5a7057 service nova] Creating event network-changed:90d4b267-6b9e-479b-978c-9e4434caa2b0 for instance c374291c-87f7-45dd-9391-807207d937bc on hv-cinder-82308 Jul 20 08:26:48.780975 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-1eb1dfc0-386a-4ecc-a850-74b57ff70094 req-09b03565-c758-41bc-88ed-8d74ac5a7057 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062188 Jul 20 08:26:48.783372 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 84/163] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:26:48.794621 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f7374d35-51fe-47fc-b73c-83676762c30a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:48.795317 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f7374d35-51fe-47fc-b73c-83676762c30a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:48.806115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f7374d35-51fe-47fc-b73c-83676762c30a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:48.806551 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f7374d35-51fe-47fc-b73c-83676762c30a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:48.807556 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f7374d35-51fe-47fc-b73c-83676762c30a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:48.808330 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f7374d35-51fe-47fc-b73c-83676762c30a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:48.907263 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-59eff562-78fc-400d-9009-20c8e53a3c79 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:48.915957 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-59eff562-78fc-400d-9009-20c8e53a3c79 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.356981 Jul 20 08:26:48.916561 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 80/164] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:48 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:49.048838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f7374d35-51fe-47fc-b73c-83676762c30a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:49.063869 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f7374d35-51fe-47fc-b73c-83676762c30a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.274675 Jul 20 08:26:49.065257 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 85/165] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:48 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:49.226201 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5c683d03-4291-4a4d-9139-c912df6b889e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:49.227206 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5c683d03-4291-4a4d-9139-c912df6b889e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:49.235620 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5c683d03-4291-4a4d-9139-c912df6b889e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:49.236084 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5c683d03-4291-4a4d-9139-c912df6b889e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:49.237128 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5c683d03-4291-4a4d-9139-c912df6b889e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:49.237873 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5c683d03-4291-4a4d-9139-c912df6b889e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:49.416030 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5c683d03-4291-4a4d-9139-c912df6b889e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:49.426722 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5c683d03-4291-4a4d-9139-c912df6b889e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.206017 Jul 20 08:26:49.427474 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 81/166] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:49 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:49.592755 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ea88cc1e-bd8a-4eaf-8fae-23c361baac9d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:49.594558 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ea88cc1e-bd8a-4eaf-8fae-23c361baac9d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:49.604909 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ea88cc1e-bd8a-4eaf-8fae-23c361baac9d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:49.605655 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ea88cc1e-bd8a-4eaf-8fae-23c361baac9d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:49.606661 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ea88cc1e-bd8a-4eaf-8fae-23c361baac9d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:49.607245 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ea88cc1e-bd8a-4eaf-8fae-23c361baac9d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:49.743708 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ca7eaf9a-576a-465a-891e-a0741f1fbe4a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:49.745914 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ca7eaf9a-576a-465a-891e-a0741f1fbe4a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:49.759726 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ca7eaf9a-576a-465a-891e-a0741f1fbe4a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:49.760902 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ca7eaf9a-576a-465a-891e-a0741f1fbe4a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:49.762562 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ca7eaf9a-576a-465a-891e-a0741f1fbe4a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:49.763599 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ca7eaf9a-576a-465a-891e-a0741f1fbe4a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:49.841955 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ea88cc1e-bd8a-4eaf-8fae-23c361baac9d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:49.851985 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ea88cc1e-bd8a-4eaf-8fae-23c361baac9d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.268064 Jul 20 08:26:49.853118 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 86/167] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:49 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:49.933766 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-079b2188-a6a5-4661-ab4b-a03062642bae tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:49.934374 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-079b2188-a6a5-4661-ab4b-a03062642bae tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:49.942571 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-079b2188-a6a5-4661-ab4b-a03062642bae tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:49.943418 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-079b2188-a6a5-4661-ab4b-a03062642bae tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:49.944287 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-079b2188-a6a5-4661-ab4b-a03062642bae tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:49.944789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-079b2188-a6a5-4661-ab4b-a03062642bae tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:49.998782 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ca7eaf9a-576a-465a-891e-a0741f1fbe4a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:50.018794 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ca7eaf9a-576a-465a-891e-a0741f1fbe4a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:50.022707 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ca7eaf9a-576a-465a-891e-a0741f1fbe4a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:50.025105 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ca7eaf9a-576a-465a-891e-a0741f1fbe4a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.291071 Jul 20 08:26:50.026861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 82/168] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:49 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:26:50.082223 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ad7a3c2a-44cb-49ca-96a0-1c01b9f76f43 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:50.082870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ad7a3c2a-44cb-49ca-96a0-1c01b9f76f43 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:50.089450 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ad7a3c2a-44cb-49ca-96a0-1c01b9f76f43 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:50.090079 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ad7a3c2a-44cb-49ca-96a0-1c01b9f76f43 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:50.090746 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ad7a3c2a-44cb-49ca-96a0-1c01b9f76f43 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:50.091263 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ad7a3c2a-44cb-49ca-96a0-1c01b9f76f43 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:50.175631 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-079b2188-a6a5-4661-ab4b-a03062642bae tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:50.184015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-079b2188-a6a5-4661-ab4b-a03062642bae tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.253980 Jul 20 08:26:50.184614 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 87/169] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:49 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:50.293490 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ad7a3c2a-44cb-49ca-96a0-1c01b9f76f43 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:50.301977 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ad7a3c2a-44cb-49ca-96a0-1c01b9f76f43 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.224380 Jul 20 08:26:50.302603 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 83/170] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:50 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:50.448015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-fad8dfda-e39e-4fe9-a2fa-2901157a83b4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:50.448881 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-fad8dfda-e39e-4fe9-a2fa-2901157a83b4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:50.460179 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fad8dfda-e39e-4fe9-a2fa-2901157a83b4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:50.462149 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fad8dfda-e39e-4fe9-a2fa-2901157a83b4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:50.465110 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fad8dfda-e39e-4fe9-a2fa-2901157a83b4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:50.465943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fad8dfda-e39e-4fe9-a2fa-2901157a83b4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:50.686435 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-fad8dfda-e39e-4fe9-a2fa-2901157a83b4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:50.695378 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-fad8dfda-e39e-4fe9-a2fa-2901157a83b4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.253257 Jul 20 08:26:50.695966 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 88/171] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:50 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:50.872983 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-0b8ba608-c2a9-4cb4-ba63-fdd03b3cc0e8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:50.873603 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-0b8ba608-c2a9-4cb4-ba63-fdd03b3cc0e8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:50.881393 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0b8ba608-c2a9-4cb4-ba63-fdd03b3cc0e8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:50.881831 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0b8ba608-c2a9-4cb4-ba63-fdd03b3cc0e8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:50.882627 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0b8ba608-c2a9-4cb4-ba63-fdd03b3cc0e8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:50.883059 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0b8ba608-c2a9-4cb4-ba63-fdd03b3cc0e8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:51.045261 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0b8ba608-c2a9-4cb4-ba63-fdd03b3cc0e8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:51.055943 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-0b8ba608-c2a9-4cb4-ba63-fdd03b3cc0e8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.186800 Jul 20 08:26:51.067007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ec7f3f29-9f1f-4ca4-9cf5-75c4f93b0df3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:51.067007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ec7f3f29-9f1f-4ca4-9cf5-75c4f93b0df3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:51.068073 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 84/172] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:50 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:51.074087 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ec7f3f29-9f1f-4ca4-9cf5-75c4f93b0df3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:51.074524 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ec7f3f29-9f1f-4ca4-9cf5-75c4f93b0df3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:51.075349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ec7f3f29-9f1f-4ca4-9cf5-75c4f93b0df3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:51.075775 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ec7f3f29-9f1f-4ca4-9cf5-75c4f93b0df3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:51.202612 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-bcd2a299-4d0f-47ea-b4af-4dd6fa9e5da5 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:51.204180 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-bcd2a299-4d0f-47ea-b4af-4dd6fa9e5da5 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:51.211605 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bcd2a299-4d0f-47ea-b4af-4dd6fa9e5da5 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:51.212336 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bcd2a299-4d0f-47ea-b4af-4dd6fa9e5da5 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:51.213304 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bcd2a299-4d0f-47ea-b4af-4dd6fa9e5da5 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:51.213842 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bcd2a299-4d0f-47ea-b4af-4dd6fa9e5da5 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:51.239098 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ec7f3f29-9f1f-4ca4-9cf5-75c4f93b0df3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:51.255784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ec7f3f29-9f1f-4ca4-9cf5-75c4f93b0df3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:51.259131 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ec7f3f29-9f1f-4ca4-9cf5-75c4f93b0df3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:51.261152 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ec7f3f29-9f1f-4ca4-9cf5-75c4f93b0df3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.208254 Jul 20 08:26:51.261997 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 89/173] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:51 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:26:51.320346 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b308fc51-1c9c-459f-92fe-ef17835001b6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:51.320961 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b308fc51-1c9c-459f-92fe-ef17835001b6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:51.328657 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b308fc51-1c9c-459f-92fe-ef17835001b6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:51.329314 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b308fc51-1c9c-459f-92fe-ef17835001b6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:51.330130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b308fc51-1c9c-459f-92fe-ef17835001b6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:51.330569 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b308fc51-1c9c-459f-92fe-ef17835001b6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:51.400830 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-bcd2a299-4d0f-47ea-b4af-4dd6fa9e5da5 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:51.409932 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-bcd2a299-4d0f-47ea-b4af-4dd6fa9e5da5 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.212134 Jul 20 08:26:51.410537 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 85/174] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:51 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:51.498359 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b308fc51-1c9c-459f-92fe-ef17835001b6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:51.507358 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b308fc51-1c9c-459f-92fe-ef17835001b6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.190907 Jul 20 08:26:51.507961 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 90/175] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:51 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:51.719434 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6829f84a-20bb-4407-85c1-7976f679bcc9 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:51.721796 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6829f84a-20bb-4407-85c1-7976f679bcc9 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:51.735547 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6829f84a-20bb-4407-85c1-7976f679bcc9 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:51.736410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6829f84a-20bb-4407-85c1-7976f679bcc9 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:51.738428 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6829f84a-20bb-4407-85c1-7976f679bcc9 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:51.739580 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6829f84a-20bb-4407-85c1-7976f679bcc9 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:52.081481 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-48224613-009a-4402-8190-1d3ba09211d2 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:52.084267 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-48224613-009a-4402-8190-1d3ba09211d2 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:52.106378 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-48224613-009a-4402-8190-1d3ba09211d2 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:52.107142 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-48224613-009a-4402-8190-1d3ba09211d2 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:52.108933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-48224613-009a-4402-8190-1d3ba09211d2 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:52.113130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-48224613-009a-4402-8190-1d3ba09211d2 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:52.170295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6829f84a-20bb-4407-85c1-7976f679bcc9 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:52.189917 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6829f84a-20bb-4407-85c1-7976f679bcc9 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.479659 Jul 20 08:26:52.191843 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 86/176] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:51 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:52.281175 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-bcae66c3-abfd-4462-b945-738caf9b4745 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:52.282297 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-bcae66c3-abfd-4462-b945-738caf9b4745 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:52.289085 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bcae66c3-abfd-4462-b945-738caf9b4745 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:52.289537 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bcae66c3-abfd-4462-b945-738caf9b4745 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:52.290362 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bcae66c3-abfd-4462-b945-738caf9b4745 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:52.290856 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bcae66c3-abfd-4462-b945-738caf9b4745 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:52.308008 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:52.319299 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-48224613-009a-4402-8190-1d3ba09211d2 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:52.330768 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-48224613-009a-4402-8190-1d3ba09211d2 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.259350 Jul 20 08:26:52.331548 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 91/177] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:52 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:52.427616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3150b8b7-e847-4938-9ea1-326b5c4e8000 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:52.428230 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-3150b8b7-e847-4938-9ea1-326b5c4e8000 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:52.434936 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3150b8b7-e847-4938-9ea1-326b5c4e8000 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:52.435269 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3150b8b7-e847-4938-9ea1-326b5c4e8000 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:52.436052 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3150b8b7-e847-4938-9ea1-326b5c4e8000 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:52.436485 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3150b8b7-e847-4938-9ea1-326b5c4e8000 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:52.446849 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-bcae66c3-abfd-4462-b945-738caf9b4745 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:52.465512 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-bcae66c3-abfd-4462-b945-738caf9b4745 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:52.469230 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-bcae66c3-abfd-4462-b945-738caf9b4745 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:52.471588 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-bcae66c3-abfd-4462-b945-738caf9b4745 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.194156 Jul 20 08:26:52.472606 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 87/178] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:52 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:52.528200 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6e3d615b-cffe-4dc5-9b28-213b301025e9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:52.529331 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6e3d615b-cffe-4dc5-9b28-213b301025e9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:52.539812 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6e3d615b-cffe-4dc5-9b28-213b301025e9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:52.540539 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6e3d615b-cffe-4dc5-9b28-213b301025e9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:52.541812 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6e3d615b-cffe-4dc5-9b28-213b301025e9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:52.542552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6e3d615b-cffe-4dc5-9b28-213b301025e9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:52.623534 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3150b8b7-e847-4938-9ea1-326b5c4e8000 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:52.636616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-3150b8b7-e847-4938-9ea1-326b5c4e8000 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.213217 Jul 20 08:26:52.637222 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 92/179] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:52 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:52.724789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6e3d615b-cffe-4dc5-9b28-213b301025e9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:52.739049 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6e3d615b-cffe-4dc5-9b28-213b301025e9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.216503 Jul 20 08:26:52.740194 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 88/180] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:52 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:53.225490 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-81b7d70b-3f3c-4bfe-90cd-ca9c3e7468ed tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:53.227120 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-81b7d70b-3f3c-4bfe-90cd-ca9c3e7468ed tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:53.238238 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-81b7d70b-3f3c-4bfe-90cd-ca9c3e7468ed tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:53.238967 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-81b7d70b-3f3c-4bfe-90cd-ca9c3e7468ed tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:53.240349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-81b7d70b-3f3c-4bfe-90cd-ca9c3e7468ed tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:53.241406 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-81b7d70b-3f3c-4bfe-90cd-ca9c3e7468ed tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:53.352156 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e2524326-c578-42ee-b410-bb755c2fc776 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:53.353191 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e2524326-c578-42ee-b410-bb755c2fc776 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:53.383093 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e2524326-c578-42ee-b410-bb755c2fc776 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:53.384221 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e2524326-c578-42ee-b410-bb755c2fc776 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:53.386297 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e2524326-c578-42ee-b410-bb755c2fc776 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:53.388020 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e2524326-c578-42ee-b410-bb755c2fc776 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:53.539053 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-81b7d70b-3f3c-4bfe-90cd-ca9c3e7468ed tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:53.577596 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-81b7d70b-3f3c-4bfe-90cd-ca9c3e7468ed tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.365849 Jul 20 08:26:53.579642 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 93/181] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:53 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:53.591931 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5afe4432-3852-4842-a1c0-02815809206f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:53.594800 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-5afe4432-3852-4842-a1c0-02815809206f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:53.609453 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5afe4432-3852-4842-a1c0-02815809206f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:53.610565 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5afe4432-3852-4842-a1c0-02815809206f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:53.612558 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5afe4432-3852-4842-a1c0-02815809206f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:53.613375 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5afe4432-3852-4842-a1c0-02815809206f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:53.743481 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e2524326-c578-42ee-b410-bb755c2fc776 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:53.753066 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e2524326-c578-42ee-b410-bb755c2fc776 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.407948 Jul 20 08:26:53.767289 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 89/182] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:53 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:53.777226 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d48d1530-e0b8-4068-a3e5-76cd104594eb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:53.777775 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d48d1530-e0b8-4068-a3e5-76cd104594eb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:53.785200 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d48d1530-e0b8-4068-a3e5-76cd104594eb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:53.785939 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d48d1530-e0b8-4068-a3e5-76cd104594eb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:53.787250 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d48d1530-e0b8-4068-a3e5-76cd104594eb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:53.787947 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d48d1530-e0b8-4068-a3e5-76cd104594eb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:53.941219 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5afe4432-3852-4842-a1c0-02815809206f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:53.962392 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5afe4432-3852-4842-a1c0-02815809206f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:53.966794 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5afe4432-3852-4842-a1c0-02815809206f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:53.970016 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-5afe4432-3852-4842-a1c0-02815809206f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.387921 Jul 20 08:26:53.971405 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 94/183] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:53 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:53.981884 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5cef07c9-e295-4672-a659-a5fd32061519 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:53.983271 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-5cef07c9-e295-4672-a659-a5fd32061519 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:53.993711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5cef07c9-e295-4672-a659-a5fd32061519 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:53.994477 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5cef07c9-e295-4672-a659-a5fd32061519 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:53.995908 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5cef07c9-e295-4672-a659-a5fd32061519 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:53.996696 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5cef07c9-e295-4672-a659-a5fd32061519 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:54.089301 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d48d1530-e0b8-4068-a3e5-76cd104594eb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:54.104619 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d48d1530-e0b8-4068-a3e5-76cd104594eb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.333843 Jul 20 08:26:54.119432 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 90/184] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:53 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:54.202637 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5cef07c9-e295-4672-a659-a5fd32061519 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:54.211773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-5cef07c9-e295-4672-a659-a5fd32061519 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.238090 Jul 20 08:26:54.212377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 95/185] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:53 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:54.612436 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ab666ff6-c9f7-4c90-9462-81a18dada4df tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:54.613675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ab666ff6-c9f7-4c90-9462-81a18dada4df tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:54.634117 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ab666ff6-c9f7-4c90-9462-81a18dada4df tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:54.634952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ab666ff6-c9f7-4c90-9462-81a18dada4df tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:54.636339 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ab666ff6-c9f7-4c90-9462-81a18dada4df tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:54.637096 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ab666ff6-c9f7-4c90-9462-81a18dada4df tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:54.782388 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-358ccc2d-c4d8-4d5a-92f3-df1b0a5ff77c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:54.783224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-358ccc2d-c4d8-4d5a-92f3-df1b0a5ff77c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:54.803946 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-358ccc2d-c4d8-4d5a-92f3-df1b0a5ff77c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:54.804396 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-358ccc2d-c4d8-4d5a-92f3-df1b0a5ff77c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:54.805569 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-358ccc2d-c4d8-4d5a-92f3-df1b0a5ff77c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:54.806315 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-358ccc2d-c4d8-4d5a-92f3-df1b0a5ff77c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:55.038009 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ab666ff6-c9f7-4c90-9462-81a18dada4df tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:55.048190 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ab666ff6-c9f7-4c90-9462-81a18dada4df tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.444528 Jul 20 08:26:55.049607 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 91/186] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:54 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:55.055856 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f8eaf211-293b-41d2-a2df-2b163ab6a430 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:55.056759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f8eaf211-293b-41d2-a2df-2b163ab6a430 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:55.066661 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f8eaf211-293b-41d2-a2df-2b163ab6a430 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:55.067508 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f8eaf211-293b-41d2-a2df-2b163ab6a430 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:55.069081 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f8eaf211-293b-41d2-a2df-2b163ab6a430 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:55.069730 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f8eaf211-293b-41d2-a2df-2b163ab6a430 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:55.248851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f8eaf211-293b-41d2-a2df-2b163ab6a430 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:55.262308 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f8eaf211-293b-41d2-a2df-2b163ab6a430 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:55.264618 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f8eaf211-293b-41d2-a2df-2b163ab6a430 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:55.267266 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f8eaf211-293b-41d2-a2df-2b163ab6a430 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.216131 Jul 20 08:26:55.277743 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 92/187] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:55 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:55.300073 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3691388b-581c-4fa7-bb3f-e3fcdf54ce34 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:55.301496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3691388b-581c-4fa7-bb3f-e3fcdf54ce34 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:55.318007 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3691388b-581c-4fa7-bb3f-e3fcdf54ce34 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:55.319350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3691388b-581c-4fa7-bb3f-e3fcdf54ce34 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:55.321564 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3691388b-581c-4fa7-bb3f-e3fcdf54ce34 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:55.322937 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3691388b-581c-4fa7-bb3f-e3fcdf54ce34 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:55.369339 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-358ccc2d-c4d8-4d5a-92f3-df1b0a5ff77c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:55.380952 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-358ccc2d-c4d8-4d5a-92f3-df1b0a5ff77c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.605523 Jul 20 08:26:55.381491 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 96/188] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:54 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:55.391424 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e3843be9-559c-4ac4-b887-0b99d755bed5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:55.394622 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-e3843be9-559c-4ac4-b887-0b99d755bed5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:55.407109 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e3843be9-559c-4ac4-b887-0b99d755bed5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:55.407868 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e3843be9-559c-4ac4-b887-0b99d755bed5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:55.409006 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e3843be9-559c-4ac4-b887-0b99d755bed5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:55.409782 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e3843be9-559c-4ac4-b887-0b99d755bed5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:55.566287 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3691388b-581c-4fa7-bb3f-e3fcdf54ce34 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:55.575610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3691388b-581c-4fa7-bb3f-e3fcdf54ce34 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.295295 Jul 20 08:26:55.580967 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 93/189] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:55 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:55.588068 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-24b4b397-b332-43b2-8fe4-2142e7acaae1 req-0aea1fbb-fc16-46fb-82c9-cdb49836aa45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b295e0-508c-4cd5-b18f-3b808c0ff265", "name": "network-vif-plugged", "status": "completed", "tag": "25187f6d-a614-4168-94dd-d0c397aaf6f3"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:26:55.598880 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-24b4b397-b332-43b2-8fe4-2142e7acaae1 req-0aea1fbb-fc16-46fb-82c9-cdb49836aa45 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:55.599329 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-24b4b397-b332-43b2-8fe4-2142e7acaae1 req-0aea1fbb-fc16-46fb-82c9-cdb49836aa45 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:55.615598 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-24b4b397-b332-43b2-8fe4-2142e7acaae1 req-0aea1fbb-fc16-46fb-82c9-cdb49836aa45 service nova] Creating event network-vif-plugged:25187f6d-a614-4168-94dd-d0c397aaf6f3 for instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 on hv-cinder-82308 Jul 20 08:26:55.621704 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-24b4b397-b332-43b2-8fe4-2142e7acaae1 req-0aea1fbb-fc16-46fb-82c9-cdb49836aa45 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044245 Jul 20 08:26:55.622326 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 94/190] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:26:55.705581 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e3843be9-559c-4ac4-b887-0b99d755bed5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:55.708265 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=100 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:26:55.715828 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e3843be9-559c-4ac4-b887-0b99d755bed5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.333182 Jul 20 08:26:55.717130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 97/191] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:55 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:56.079734 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5976d3d3-49e7-48e6-b731-534c9be0a01a tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:56.080432 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5976d3d3-49e7-48e6-b731-534c9be0a01a tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:56.087917 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5976d3d3-49e7-48e6-b731-534c9be0a01a tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:56.088843 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5976d3d3-49e7-48e6-b731-534c9be0a01a tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:56.090145 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5976d3d3-49e7-48e6-b731-534c9be0a01a tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:56.090827 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5976d3d3-49e7-48e6-b731-534c9be0a01a tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:56.292029 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-922025d4-79a3-4148-8ad6-584f0bbea9dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:56.296183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-922025d4-79a3-4148-8ad6-584f0bbea9dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:56.312059 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-922025d4-79a3-4148-8ad6-584f0bbea9dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:56.313287 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-922025d4-79a3-4148-8ad6-584f0bbea9dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:56.315172 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-922025d4-79a3-4148-8ad6-584f0bbea9dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:56.317150 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-922025d4-79a3-4148-8ad6-584f0bbea9dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:56.357727 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5976d3d3-49e7-48e6-b731-534c9be0a01a tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:56.377343 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5976d3d3-49e7-48e6-b731-534c9be0a01a tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.298879 Jul 20 08:26:56.377343 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 95/192] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:56 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:56.412062 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d3ac0b5c-ad1c-4d39-ad39-eec467dbadb7 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:56.413200 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d3ac0b5c-ad1c-4d39-ad39-eec467dbadb7 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:56.428087 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d3ac0b5c-ad1c-4d39-ad39-eec467dbadb7 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:56.429040 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d3ac0b5c-ad1c-4d39-ad39-eec467dbadb7 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:56.430562 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d3ac0b5c-ad1c-4d39-ad39-eec467dbadb7 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:56.431387 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d3ac0b5c-ad1c-4d39-ad39-eec467dbadb7 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:56.711158 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d3ac0b5c-ad1c-4d39-ad39-eec467dbadb7 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:56.730860 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d3ac0b5c-ad1c-4d39-ad39-eec467dbadb7 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.327016 Jul 20 08:26:56.732186 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 96/193] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:56 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:56.742736 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-70f12094-5d70-4ec3-8c1e-48aea766b6f9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:56.744968 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-70f12094-5d70-4ec3-8c1e-48aea766b6f9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:56.761073 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-70f12094-5d70-4ec3-8c1e-48aea766b6f9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:56.762228 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-70f12094-5d70-4ec3-8c1e-48aea766b6f9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:56.767183 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-70f12094-5d70-4ec3-8c1e-48aea766b6f9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:56.769947 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-70f12094-5d70-4ec3-8c1e-48aea766b6f9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:56.884356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-922025d4-79a3-4148-8ad6-584f0bbea9dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:56.909078 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-922025d4-79a3-4148-8ad6-584f0bbea9dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:56.914105 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-922025d4-79a3-4148-8ad6-584f0bbea9dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:56.917144 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-922025d4-79a3-4148-8ad6-584f0bbea9dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.633573 Jul 20 08:26:56.918469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 98/194] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:56 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:26:56.932800 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a8e912e9-4f78-4819-a6c7-add52ea9450f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:56.934363 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a8e912e9-4f78-4819-a6c7-add52ea9450f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:56.949137 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a8e912e9-4f78-4819-a6c7-add52ea9450f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:56.951126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a8e912e9-4f78-4819-a6c7-add52ea9450f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:56.953723 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a8e912e9-4f78-4819-a6c7-add52ea9450f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:56.955280 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a8e912e9-4f78-4819-a6c7-add52ea9450f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:57.179329 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-70f12094-5d70-4ec3-8c1e-48aea766b6f9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:57.207765 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-70f12094-5d70-4ec3-8c1e-48aea766b6f9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.473236 Jul 20 08:26:57.225311 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 97/195] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:56 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:57.351097 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a8e912e9-4f78-4819-a6c7-add52ea9450f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:57.372982 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a8e912e9-4f78-4819-a6c7-add52ea9450f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1322 microversion: 2.1 time: 0.452020 Jul 20 08:26:57.376263 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 99/196] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:56 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1322 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:57.398491 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e633d714-4519-42d5-920e-23a16fe2451c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:57.401526 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e633d714-4519-42d5-920e-23a16fe2451c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:57.418849 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e633d714-4519-42d5-920e-23a16fe2451c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:57.419698 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e633d714-4519-42d5-920e-23a16fe2451c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:57.422014 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e633d714-4519-42d5-920e-23a16fe2451c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:57.422918 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e633d714-4519-42d5-920e-23a16fe2451c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:57.739135 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e633d714-4519-42d5-920e-23a16fe2451c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:57.754968 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e633d714-4519-42d5-920e-23a16fe2451c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.364601 Jul 20 08:26:57.756883 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 98/197] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:57 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:57.760857 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ba0caee3-2323-47b6-84a0-962202afbd7e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:57.761468 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ba0caee3-2323-47b6-84a0-962202afbd7e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:57.777473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ba0caee3-2323-47b6-84a0-962202afbd7e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:57.778081 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ba0caee3-2323-47b6-84a0-962202afbd7e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:57.778940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ba0caee3-2323-47b6-84a0-962202afbd7e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:57.779542 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ba0caee3-2323-47b6-84a0-962202afbd7e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:57.955902 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5ca42a70-1e73-4a48-b32b-cde59e6bd325 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:57.957007 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5ca42a70-1e73-4a48-b32b-cde59e6bd325 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:57.997606 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5ca42a70-1e73-4a48-b32b-cde59e6bd325 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:58.001824 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5ca42a70-1e73-4a48-b32b-cde59e6bd325 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:58.013679 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5ca42a70-1e73-4a48-b32b-cde59e6bd325 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:58.027530 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5ca42a70-1e73-4a48-b32b-cde59e6bd325 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:58.062411 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ba0caee3-2323-47b6-84a0-962202afbd7e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:58.081623 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ba0caee3-2323-47b6-84a0-962202afbd7e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.324816 Jul 20 08:26:58.084439 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 100/198] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:57 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:58.234716 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-6b6f47e2-6fe4-498e-8db8-f8d8ed493131 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:58.235552 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-6b6f47e2-6fe4-498e-8db8-f8d8ed493131 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:58.253784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6b6f47e2-6fe4-498e-8db8-f8d8ed493131 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:58.254515 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6b6f47e2-6fe4-498e-8db8-f8d8ed493131 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:58.255569 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6b6f47e2-6fe4-498e-8db8-f8d8ed493131 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:58.256316 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6b6f47e2-6fe4-498e-8db8-f8d8ed493131 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:58.591262 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-6b6f47e2-6fe4-498e-8db8-f8d8ed493131 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:58.605131 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-6b6f47e2-6fe4-498e-8db8-f8d8ed493131 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.383114 Jul 20 08:26:58.619713 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 101/199] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:58 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:26:58.633114 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5f9d2747-61fc-4891-9c62-2e4354b31dc4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:58.634175 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-5f9d2747-61fc-4891-9c62-2e4354b31dc4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:58.650027 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5f9d2747-61fc-4891-9c62-2e4354b31dc4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:58.652981 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5f9d2747-61fc-4891-9c62-2e4354b31dc4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:58.657928 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5f9d2747-61fc-4891-9c62-2e4354b31dc4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:58.662020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5f9d2747-61fc-4891-9c62-2e4354b31dc4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:58.679476 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5ca42a70-1e73-4a48-b32b-cde59e6bd325 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:58.710810 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5ca42a70-1e73-4a48-b32b-cde59e6bd325 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:58.715818 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5ca42a70-1e73-4a48-b32b-cde59e6bd325 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:58.722071 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5ca42a70-1e73-4a48-b32b-cde59e6bd325 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.772964 Jul 20 08:26:58.723808 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 99/200] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:57 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:26:58.793659 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-86edcf7c-4e77-4ec8-8c58-386317ad22b6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:58.795656 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-86edcf7c-4e77-4ec8-8c58-386317ad22b6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:58.824211 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-86edcf7c-4e77-4ec8-8c58-386317ad22b6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:58.825528 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-86edcf7c-4e77-4ec8-8c58-386317ad22b6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:58.827480 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-86edcf7c-4e77-4ec8-8c58-386317ad22b6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:58.829595 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-86edcf7c-4e77-4ec8-8c58-386317ad22b6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:58.949741 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5f9d2747-61fc-4891-9c62-2e4354b31dc4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:58.966251 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-5f9d2747-61fc-4891-9c62-2e4354b31dc4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1517 microversion: 2.1 time: 0.344617 Jul 20 08:26:58.969027 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 102/201] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:58 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1517 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:59.008754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-4fbfcf50-6c44-4bf0-b413-3269aab25468 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:26:59.017912 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-4fbfcf50-6c44-4bf0-b413-3269aab25468 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:59.041457 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4fbfcf50-6c44-4bf0-b413-3269aab25468 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:59.043192 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4fbfcf50-6c44-4bf0-b413-3269aab25468 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:59.046198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4fbfcf50-6c44-4bf0-b413-3269aab25468 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:59.049565 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4fbfcf50-6c44-4bf0-b413-3269aab25468 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:59.205127 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.objects.instance [None req-4fbfcf50-6c44-4bf0-b413-3269aab25468 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lazy-loading 'flavor' on Instance uuid ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a {{(pid=117828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:26:59.315119 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-86edcf7c-4e77-4ec8-8c58-386317ad22b6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:59.331179 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-86edcf7c-4e77-4ec8-8c58-386317ad22b6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.545481 Jul 20 08:26:59.332245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 100/202] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:58 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:59.337525 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a45522cf-b861-4af6-a9b0-97b98239f6e8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:59.338193 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a45522cf-b861-4af6-a9b0-97b98239f6e8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:59.357427 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a45522cf-b861-4af6-a9b0-97b98239f6e8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:59.358747 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a45522cf-b861-4af6-a9b0-97b98239f6e8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:59.358747 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a45522cf-b861-4af6-a9b0-97b98239f6e8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:59.359406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a45522cf-b861-4af6-a9b0-97b98239f6e8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:59.478457 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-4fbfcf50-6c44-4bf0-b413-3269aab25468 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "POST /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a/action" status: 200 len: 32 microversion: 2.1 time: 0.482993 Jul 20 08:26:59.492277 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 103/203] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Jul 20 08:26:58 2022] POST /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a/action => generated 32 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 08:26:59.523716 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-64f15fdb-adca-4734-85e3-e0e20bdf2889 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:59.525113 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-64f15fdb-adca-4734-85e3-e0e20bdf2889 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:59.554557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-64f15fdb-adca-4734-85e3-e0e20bdf2889 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:59.555651 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-64f15fdb-adca-4734-85e3-e0e20bdf2889 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:59.561194 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-64f15fdb-adca-4734-85e3-e0e20bdf2889 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:59.563863 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-64f15fdb-adca-4734-85e3-e0e20bdf2889 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:59.616687 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a45522cf-b861-4af6-a9b0-97b98239f6e8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:59.626674 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a45522cf-b861-4af6-a9b0-97b98239f6e8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.293044 Jul 20 08:26:59.636495 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 101/204] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:59 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:59.642374 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-aa79faee-a044-4e56-adb6-85b2f37ea54c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:59.643275 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-aa79faee-a044-4e56-adb6-85b2f37ea54c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:59.650230 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aa79faee-a044-4e56-adb6-85b2f37ea54c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:59.650759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aa79faee-a044-4e56-adb6-85b2f37ea54c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:59.651717 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aa79faee-a044-4e56-adb6-85b2f37ea54c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:59.652311 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aa79faee-a044-4e56-adb6-85b2f37ea54c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:59.936152 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-aa79faee-a044-4e56-adb6-85b2f37ea54c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:26:59.947899 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-aa79faee-a044-4e56-adb6-85b2f37ea54c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.310034 Jul 20 08:26:59.961464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 102/205] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:59 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:26:59.970059 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-642f97af-1dab-42df-ac51-3ea2c3e5cac1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:26:59.973360 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-642f97af-1dab-42df-ac51-3ea2c3e5cac1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:26:59.989233 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-642f97af-1dab-42df-ac51-3ea2c3e5cac1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:59.990055 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-642f97af-1dab-42df-ac51-3ea2c3e5cac1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:26:59.991162 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-642f97af-1dab-42df-ac51-3ea2c3e5cac1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:26:59.998748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-642f97af-1dab-42df-ac51-3ea2c3e5cac1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:00.096800 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-64f15fdb-adca-4734-85e3-e0e20bdf2889 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:00.110424 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-64f15fdb-adca-4734-85e3-e0e20bdf2889 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.615599 Jul 20 08:27:00.111435 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 104/206] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:26:59 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:00.117196 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-bd331d75-316c-48a0-9e6d-70e3383204c2 req-fabaa6b1-6052-48b1-839f-3aad505a3ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0df430-d3f8-4e9d-949f-5d8f0359484d", "name": "network-vif-plugged", "status": "completed", "tag": "1a663922-bde3-4ffe-a3dd-70862157632c"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:27:00.127143 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-bd331d75-316c-48a0-9e6d-70e3383204c2 req-fabaa6b1-6052-48b1-839f-3aad505a3ad6 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:00.127828 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-bd331d75-316c-48a0-9e6d-70e3383204c2 req-fabaa6b1-6052-48b1-839f-3aad505a3ad6 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:00.141438 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-bd331d75-316c-48a0-9e6d-70e3383204c2 req-fabaa6b1-6052-48b1-839f-3aad505a3ad6 service nova] Creating event network-vif-plugged:1a663922-bde3-4ffe-a3dd-70862157632c for instance fa0df430-d3f8-4e9d-949f-5d8f0359484d on hv-cinder-82308 Jul 20 08:27:00.147787 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-bd331d75-316c-48a0-9e6d-70e3383204c2 req-fabaa6b1-6052-48b1-839f-3aad505a3ad6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034956 Jul 20 08:27:00.148981 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 105/207] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:27:00.366317 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ead44dc7-fa86-4112-a3f7-69d306eb5423 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:00.367215 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ead44dc7-fa86-4112-a3f7-69d306eb5423 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:00.374609 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-642f97af-1dab-42df-ac51-3ea2c3e5cac1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:00.391916 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-642f97af-1dab-42df-ac51-3ea2c3e5cac1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:00.393507 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-642f97af-1dab-42df-ac51-3ea2c3e5cac1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:00.396630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ead44dc7-fa86-4112-a3f7-69d306eb5423 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:00.396630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ead44dc7-fa86-4112-a3f7-69d306eb5423 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:00.397208 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ead44dc7-fa86-4112-a3f7-69d306eb5423 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:00.397756 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ead44dc7-fa86-4112-a3f7-69d306eb5423 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:00.400990 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-642f97af-1dab-42df-ac51-3ea2c3e5cac1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.437922 Jul 20 08:27:00.416072 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 103/208] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:26:59 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:27:00.646481 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-7211d17a-1e17-4b08-ab22-6d9da80fff8b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:00.648240 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-7211d17a-1e17-4b08-ab22-6d9da80fff8b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:00.658233 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7211d17a-1e17-4b08-ab22-6d9da80fff8b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:00.658614 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7211d17a-1e17-4b08-ab22-6d9da80fff8b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:00.659421 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7211d17a-1e17-4b08-ab22-6d9da80fff8b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:00.659864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7211d17a-1e17-4b08-ab22-6d9da80fff8b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:00.681157 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ead44dc7-fa86-4112-a3f7-69d306eb5423 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:00.717903 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ead44dc7-fa86-4112-a3f7-69d306eb5423 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.355307 Jul 20 08:27:00.720382 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 106/209] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:00 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:00.941117 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-7211d17a-1e17-4b08-ab22-6d9da80fff8b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:00.944099 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:27:00.964341 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-7211d17a-1e17-4b08-ab22-6d9da80fff8b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.321435 Jul 20 08:27:00.973277 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9088e076-378f-4112-869c-6af3f797bd1f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:00.976225 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9088e076-378f-4112-869c-6af3f797bd1f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:00.976457 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 104/210] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:00 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:01.012731 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9088e076-378f-4112-869c-6af3f797bd1f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:01.014254 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9088e076-378f-4112-869c-6af3f797bd1f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:01.016272 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9088e076-378f-4112-869c-6af3f797bd1f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:01.026308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9088e076-378f-4112-869c-6af3f797bd1f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:01.142547 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-baafab86-40e9-4e1e-a07a-4c52e7dfd8eb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:01.150941 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-baafab86-40e9-4e1e-a07a-4c52e7dfd8eb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:01.177736 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-baafab86-40e9-4e1e-a07a-4c52e7dfd8eb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:01.178887 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-baafab86-40e9-4e1e-a07a-4c52e7dfd8eb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:01.192571 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-baafab86-40e9-4e1e-a07a-4c52e7dfd8eb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:01.193369 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-baafab86-40e9-4e1e-a07a-4c52e7dfd8eb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:01.253500 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9088e076-378f-4112-869c-6af3f797bd1f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:01.268836 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9088e076-378f-4112-869c-6af3f797bd1f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.300286 Jul 20 08:27:01.270623 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 107/211] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:00 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:01.426074 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c0097bc4-4577-446c-8040-119eb553f8bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:01.427899 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c0097bc4-4577-446c-8040-119eb553f8bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:01.446896 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c0097bc4-4577-446c-8040-119eb553f8bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:01.450567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c0097bc4-4577-446c-8040-119eb553f8bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:01.452974 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c0097bc4-4577-446c-8040-119eb553f8bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:01.457044 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c0097bc4-4577-446c-8040-119eb553f8bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:01.468032 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-baafab86-40e9-4e1e-a07a-4c52e7dfd8eb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:01.478836 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-baafab86-40e9-4e1e-a07a-4c52e7dfd8eb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.342221 Jul 20 08:27:01.483205 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 105/212] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:01 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:01.712498 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c0097bc4-4577-446c-8040-119eb553f8bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:01.730786 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c0097bc4-4577-446c-8040-119eb553f8bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:01.737651 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c0097bc4-4577-446c-8040-119eb553f8bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:01.740796 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c0097bc4-4577-446c-8040-119eb553f8bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.319065 Jul 20 08:27:01.742202 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 108/213] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:27:01 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:27:01.744610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f06aa0d5-2a21-4947-8663-dd772380cb6e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:01.745250 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f06aa0d5-2a21-4947-8663-dd772380cb6e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:01.753972 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f06aa0d5-2a21-4947-8663-dd772380cb6e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:01.754801 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f06aa0d5-2a21-4947-8663-dd772380cb6e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:01.755733 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f06aa0d5-2a21-4947-8663-dd772380cb6e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:01.756315 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f06aa0d5-2a21-4947-8663-dd772380cb6e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:01.990796 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b6eb964a-7cf3-4889-841e-78ad0d1cb4ad tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:01.992904 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b6eb964a-7cf3-4889-841e-78ad0d1cb4ad tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:02.005719 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b6eb964a-7cf3-4889-841e-78ad0d1cb4ad tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:02.006908 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b6eb964a-7cf3-4889-841e-78ad0d1cb4ad tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:02.008555 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b6eb964a-7cf3-4889-841e-78ad0d1cb4ad tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:02.009825 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b6eb964a-7cf3-4889-841e-78ad0d1cb4ad tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:02.093005 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f06aa0d5-2a21-4947-8663-dd772380cb6e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:02.121369 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f06aa0d5-2a21-4947-8663-dd772380cb6e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.375194 Jul 20 08:27:02.122055 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 106/214] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:01 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:02.302102 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a3e26ff0-c05f-4951-82c9-b7e1d5ec080f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:02.304270 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a3e26ff0-c05f-4951-82c9-b7e1d5ec080f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:02.318567 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a3e26ff0-c05f-4951-82c9-b7e1d5ec080f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:02.319803 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a3e26ff0-c05f-4951-82c9-b7e1d5ec080f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:02.321358 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a3e26ff0-c05f-4951-82c9-b7e1d5ec080f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:02.322297 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a3e26ff0-c05f-4951-82c9-b7e1d5ec080f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:02.399507 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b6eb964a-7cf3-4889-841e-78ad0d1cb4ad tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:02.410557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b6eb964a-7cf3-4889-841e-78ad0d1cb4ad tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.429283 Jul 20 08:27:02.414624 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 109/215] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:01 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:02.461686 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-57e7c42d-96ab-4c5b-8044-346e6eba4111 req-326ed444-7a8e-443c-9a53-369181030df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659d1d17-9163-4971-9ba1-40f3f20d2650", "name": "network-vif-plugged", "status": "completed", "tag": "e37caaf1-6167-4ebe-94cd-55ea929f139d"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:27:02.477535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-57e7c42d-96ab-4c5b-8044-346e6eba4111 req-326ed444-7a8e-443c-9a53-369181030df0 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:02.482107 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-57e7c42d-96ab-4c5b-8044-346e6eba4111 req-326ed444-7a8e-443c-9a53-369181030df0 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:02.497287 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-57e7c42d-96ab-4c5b-8044-346e6eba4111 req-326ed444-7a8e-443c-9a53-369181030df0 service nova] Creating event network-vif-plugged:e37caaf1-6167-4ebe-94cd-55ea929f139d for instance 659d1d17-9163-4971-9ba1-40f3f20d2650 on hv-cinder-82308 Jul 20 08:27:02.505790 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-57e7c42d-96ab-4c5b-8044-346e6eba4111 req-326ed444-7a8e-443c-9a53-369181030df0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048588 Jul 20 08:27:02.506628 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 110/216] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:27:02.514943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-65fc2be3-83f9-4384-b3cf-b836ef1afcce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:02.516566 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-65fc2be3-83f9-4384-b3cf-b836ef1afcce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:02.525079 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-65fc2be3-83f9-4384-b3cf-b836ef1afcce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:02.526285 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-65fc2be3-83f9-4384-b3cf-b836ef1afcce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:02.527418 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-65fc2be3-83f9-4384-b3cf-b836ef1afcce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:02.528017 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-65fc2be3-83f9-4384-b3cf-b836ef1afcce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:02.652384 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a3e26ff0-c05f-4951-82c9-b7e1d5ec080f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:02.668958 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a3e26ff0-c05f-4951-82c9-b7e1d5ec080f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.377756 Jul 20 08:27:02.670168 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 107/217] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:02 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:02.775424 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-34e3b13d-ce66-46aa-9498-e6691dbc033f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:02.776084 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-34e3b13d-ce66-46aa-9498-e6691dbc033f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:02.790448 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-34e3b13d-ce66-46aa-9498-e6691dbc033f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:02.791299 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-34e3b13d-ce66-46aa-9498-e6691dbc033f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:02.793396 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-34e3b13d-ce66-46aa-9498-e6691dbc033f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:02.793968 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-34e3b13d-ce66-46aa-9498-e6691dbc033f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:02.842900 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-65fc2be3-83f9-4384-b3cf-b836ef1afcce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:02.852889 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-65fc2be3-83f9-4384-b3cf-b836ef1afcce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.343824 Jul 20 08:27:02.855135 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 111/218] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:02 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:03.063168 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-34e3b13d-ce66-46aa-9498-e6691dbc033f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:03.074778 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-34e3b13d-ce66-46aa-9498-e6691dbc033f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:03.076862 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-34e3b13d-ce66-46aa-9498-e6691dbc033f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:03.078963 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-34e3b13d-ce66-46aa-9498-e6691dbc033f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1407 microversion: 2.20 time: 0.310267 Jul 20 08:27:03.080118 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 108/219] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:27:02 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:27:03.146869 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3887b1c3-7121-440b-9994-c0ca70051bbd tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:03.149177 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-3887b1c3-7121-440b-9994-c0ca70051bbd tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:03.165110 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3887b1c3-7121-440b-9994-c0ca70051bbd tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:03.168899 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3887b1c3-7121-440b-9994-c0ca70051bbd tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:03.170217 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3887b1c3-7121-440b-9994-c0ca70051bbd tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:03.170925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3887b1c3-7121-440b-9994-c0ca70051bbd tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:03.429426 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3887b1c3-7121-440b-9994-c0ca70051bbd tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:03.436844 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e299f9ff-4299-463d-9af7-cf148cfe210d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:03.438346 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e299f9ff-4299-463d-9af7-cf148cfe210d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:03.450145 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e299f9ff-4299-463d-9af7-cf148cfe210d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:03.451074 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e299f9ff-4299-463d-9af7-cf148cfe210d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:03.452449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-3887b1c3-7121-440b-9994-c0ca70051bbd tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.310706 Jul 20 08:27:03.452681 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e299f9ff-4299-463d-9af7-cf148cfe210d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:03.454308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 112/220] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:03 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:03.455394 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e299f9ff-4299-463d-9af7-cf148cfe210d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:03.689601 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-14ed18c0-4093-4fab-a2fa-5e2d71b98137 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:03.690438 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-14ed18c0-4093-4fab-a2fa-5e2d71b98137 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:03.697469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-14ed18c0-4093-4fab-a2fa-5e2d71b98137 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:03.698004 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-14ed18c0-4093-4fab-a2fa-5e2d71b98137 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:03.698917 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-14ed18c0-4093-4fab-a2fa-5e2d71b98137 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:03.699601 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-14ed18c0-4093-4fab-a2fa-5e2d71b98137 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:03.764004 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e299f9ff-4299-463d-9af7-cf148cfe210d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:03.779485 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e299f9ff-4299-463d-9af7-cf148cfe210d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.354368 Jul 20 08:27:03.782333 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 109/221] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:03 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:03.881860 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3623c210-6f49-451a-8979-251441c50ca4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:03.883329 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3623c210-6f49-451a-8979-251441c50ca4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:03.912865 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3623c210-6f49-451a-8979-251441c50ca4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:03.913926 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3623c210-6f49-451a-8979-251441c50ca4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:03.915353 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3623c210-6f49-451a-8979-251441c50ca4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:03.916335 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3623c210-6f49-451a-8979-251441c50ca4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:04.137783 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-14ed18c0-4093-4fab-a2fa-5e2d71b98137 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:04.142233 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:27:04.158834 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-14ed18c0-4093-4fab-a2fa-5e2d71b98137 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.471527 Jul 20 08:27:04.160555 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 113/222] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:03 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:04.168828 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3c74eeb9-e72a-440e-86ab-c3d5dec0667e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:04.170413 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-3c74eeb9-e72a-440e-86ab-c3d5dec0667e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:04.179834 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3c74eeb9-e72a-440e-86ab-c3d5dec0667e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:04.180980 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3c74eeb9-e72a-440e-86ab-c3d5dec0667e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:04.182088 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3c74eeb9-e72a-440e-86ab-c3d5dec0667e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:04.182976 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3c74eeb9-e72a-440e-86ab-c3d5dec0667e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:04.542201 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3c74eeb9-e72a-440e-86ab-c3d5dec0667e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:04.563448 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3c74eeb9-e72a-440e-86ab-c3d5dec0667e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:04.569193 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3c74eeb9-e72a-440e-86ab-c3d5dec0667e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:04.572123 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-3c74eeb9-e72a-440e-86ab-c3d5dec0667e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1600 microversion: 2.20 time: 0.409873 Jul 20 08:27:04.575465 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 114/223] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:27:04 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1600 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:27:04.592246 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-29d28f4f-a3f4-4535-92a8-e761a570e1c4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:04.593153 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-29d28f4f-a3f4-4535-92a8-e761a570e1c4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:04.612374 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-29d28f4f-a3f4-4535-92a8-e761a570e1c4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:04.612959 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-29d28f4f-a3f4-4535-92a8-e761a570e1c4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:04.620639 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-29d28f4f-a3f4-4535-92a8-e761a570e1c4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:04.623383 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-29d28f4f-a3f4-4535-92a8-e761a570e1c4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:04.623799 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3623c210-6f49-451a-8979-251441c50ca4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:04.647798 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3623c210-6f49-451a-8979-251441c50ca4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.777686 Jul 20 08:27:04.650259 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 110/224] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:03 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:04.662459 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e7bda2bf-b4a7-446e-a577-8d7bee6288c6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:04.663383 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e7bda2bf-b4a7-446e-a577-8d7bee6288c6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:04.677713 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e7bda2bf-b4a7-446e-a577-8d7bee6288c6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:04.679006 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e7bda2bf-b4a7-446e-a577-8d7bee6288c6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:04.680615 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e7bda2bf-b4a7-446e-a577-8d7bee6288c6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:04.681706 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e7bda2bf-b4a7-446e-a577-8d7bee6288c6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:04.889775 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e7bda2bf-b4a7-446e-a577-8d7bee6288c6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.237523 Jul 20 08:27:04.891433 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 111/225] 10.222.0.64 () {60 vars in 1315 bytes} [Wed Jul 20 08:27:04 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-interface => generated 285 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:27:04.892512 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-29d28f4f-a3f4-4535-92a8-e761a570e1c4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:04.901108 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-29d28f4f-a3f4-4535-92a8-e761a570e1c4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.323617 Jul 20 08:27:04.901915 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 115/226] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:04 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:04.902078 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-fb0ed97b-58f4-441b-871f-636abf8301a9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:04.903243 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-fb0ed97b-58f4-441b-871f-636abf8301a9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:04.915982 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fb0ed97b-58f4-441b-871f-636abf8301a9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:04.916793 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fb0ed97b-58f4-441b-871f-636abf8301a9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:04.918270 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fb0ed97b-58f4-441b-871f-636abf8301a9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:04.919013 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fb0ed97b-58f4-441b-871f-636abf8301a9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:05.152042 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fb0ed97b-58f4-441b-871f-636abf8301a9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:05.162120 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-fb0ed97b-58f4-441b-871f-636abf8301a9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.268966 Jul 20 08:27:05.163171 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 112/227] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:04 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:05.191870 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-251108f9-e17d-4d40-8296-69e8afe979fd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:05.192485 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-251108f9-e17d-4d40-8296-69e8afe979fd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:05.199270 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-251108f9-e17d-4d40-8296-69e8afe979fd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:05.199698 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-251108f9-e17d-4d40-8296-69e8afe979fd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:05.200488 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-251108f9-e17d-4d40-8296-69e8afe979fd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:05.200921 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-251108f9-e17d-4d40-8296-69e8afe979fd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:05.676998 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-251108f9-e17d-4d40-8296-69e8afe979fd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:05.685988 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-914cf042-1abd-4806-a122-f9b46fd690b7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:05.686840 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-251108f9-e17d-4d40-8296-69e8afe979fd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.499146 Jul 20 08:27:05.687037 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 116/228] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:05 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:05.699926 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-914cf042-1abd-4806-a122-f9b46fd690b7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:05.717712 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-914cf042-1abd-4806-a122-f9b46fd690b7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:05.718265 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-914cf042-1abd-4806-a122-f9b46fd690b7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:05.719340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-914cf042-1abd-4806-a122-f9b46fd690b7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:05.719862 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-914cf042-1abd-4806-a122-f9b46fd690b7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:05.926002 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-914cf042-1abd-4806-a122-f9b46fd690b7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:05.939783 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-6676bcce-2063-4341-8dc3-eff8bab5880e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:05.940551 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-6676bcce-2063-4341-8dc3-eff8bab5880e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:05.945173 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-914cf042-1abd-4806-a122-f9b46fd690b7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.269130 Jul 20 08:27:05.947288 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 113/229] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:05 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:05.952032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6676bcce-2063-4341-8dc3-eff8bab5880e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:05.953774 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6676bcce-2063-4341-8dc3-eff8bab5880e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:05.955536 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6676bcce-2063-4341-8dc3-eff8bab5880e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:05.956729 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6676bcce-2063-4341-8dc3-eff8bab5880e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:06.182715 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f7b61d18-4705-42e1-9169-fd26b9205619 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:06.183637 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f7b61d18-4705-42e1-9169-fd26b9205619 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:06.190704 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f7b61d18-4705-42e1-9169-fd26b9205619 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:06.191157 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f7b61d18-4705-42e1-9169-fd26b9205619 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:06.191939 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f7b61d18-4705-42e1-9169-fd26b9205619 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:06.192552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f7b61d18-4705-42e1-9169-fd26b9205619 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:06.361362 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f7b61d18-4705-42e1-9169-fd26b9205619 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:06.373135 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f7b61d18-4705-42e1-9169-fd26b9205619 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.194504 Jul 20 08:27:06.374052 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 114/230] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:06 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:06.451139 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-6676bcce-2063-4341-8dc3-eff8bab5880e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:06.470891 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-6676bcce-2063-4341-8dc3-eff8bab5880e tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.543755 Jul 20 08:27:06.471464 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 117/231] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:05 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:06.710215 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6f7100f1-b725-4e7c-a82f-f7fc5558d29c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:06.711302 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6f7100f1-b725-4e7c-a82f-f7fc5558d29c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:06.738623 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6f7100f1-b725-4e7c-a82f-f7fc5558d29c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:06.739365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6f7100f1-b725-4e7c-a82f-f7fc5558d29c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:06.741147 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6f7100f1-b725-4e7c-a82f-f7fc5558d29c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:06.741907 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6f7100f1-b725-4e7c-a82f-f7fc5558d29c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:06.939318 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6f7100f1-b725-4e7c-a82f-f7fc5558d29c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:06.949687 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6f7100f1-b725-4e7c-a82f-f7fc5558d29c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.247247 Jul 20 08:27:06.950953 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 115/232] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:06 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:06.974283 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1d0a7fde-52ed-486a-bfd4-ae5504ace95f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:06.974986 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1d0a7fde-52ed-486a-bfd4-ae5504ace95f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:06.976917 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=100 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:27:06.982427 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1d0a7fde-52ed-486a-bfd4-ae5504ace95f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:06.982944 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1d0a7fde-52ed-486a-bfd4-ae5504ace95f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:06.983729 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1d0a7fde-52ed-486a-bfd4-ae5504ace95f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:06.984742 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1d0a7fde-52ed-486a-bfd4-ae5504ace95f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:07.232426 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-2aa8064e-790b-4d2b-8757-0d616d70025c req-57d041e9-aaa3-4296-a624-d8d308b91153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21b295e0-508c-4cd5-b18f-3b808c0ff265", "tag": "25187f6d-a614-4168-94dd-d0c397aaf6f3"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:27:07.242981 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-2aa8064e-790b-4d2b-8757-0d616d70025c req-57d041e9-aaa3-4296-a624-d8d308b91153 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:07.243429 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-2aa8064e-790b-4d2b-8757-0d616d70025c req-57d041e9-aaa3-4296-a624-d8d308b91153 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:07.256418 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-2aa8064e-790b-4d2b-8757-0d616d70025c req-57d041e9-aaa3-4296-a624-d8d308b91153 service nova] Creating event network-changed:25187f6d-a614-4168-94dd-d0c397aaf6f3 for instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 on hv-cinder-82308 Jul 20 08:27:07.257831 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1d0a7fde-52ed-486a-bfd4-ae5504ace95f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:07.262273 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-2aa8064e-790b-4d2b-8757-0d616d70025c req-57d041e9-aaa3-4296-a624-d8d308b91153 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033512 Jul 20 08:27:07.262923 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 116/233] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:27:07.270200 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1d0a7fde-52ed-486a-bfd4-ae5504ace95f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.300682 Jul 20 08:27:07.271013 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 118/234] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:06 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:07.392132 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c0ba9472-9022-4f9b-93df-ee3a186dd2ed tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:07.392838 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c0ba9472-9022-4f9b-93df-ee3a186dd2ed tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:07.399848 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c0ba9472-9022-4f9b-93df-ee3a186dd2ed tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:07.401141 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c0ba9472-9022-4f9b-93df-ee3a186dd2ed tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:07.401498 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c0ba9472-9022-4f9b-93df-ee3a186dd2ed tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:07.402127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c0ba9472-9022-4f9b-93df-ee3a186dd2ed tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:07.493108 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c03fe304-48df-490a-a5e1-2b7f2be49697 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:07.494036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c03fe304-48df-490a-a5e1-2b7f2be49697 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:07.503133 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c03fe304-48df-490a-a5e1-2b7f2be49697 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:07.503874 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c03fe304-48df-490a-a5e1-2b7f2be49697 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:07.505339 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c03fe304-48df-490a-a5e1-2b7f2be49697 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:07.505934 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c03fe304-48df-490a-a5e1-2b7f2be49697 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:07.587422 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c0ba9472-9022-4f9b-93df-ee3a186dd2ed tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:07.596834 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c0ba9472-9022-4f9b-93df-ee3a186dd2ed tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.209763 Jul 20 08:27:07.597537 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 117/235] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:07 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:07.727725 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c03fe304-48df-490a-a5e1-2b7f2be49697 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:07.742884 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c03fe304-48df-490a-a5e1-2b7f2be49697 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.258054 Jul 20 08:27:07.743506 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 119/236] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:07 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:07.970968 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-713975b4-fa99-4c26-92cd-709f730d576c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:07.972401 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-713975b4-fa99-4c26-92cd-709f730d576c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:07.980280 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-713975b4-fa99-4c26-92cd-709f730d576c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:07.980739 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-713975b4-fa99-4c26-92cd-709f730d576c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:07.981784 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-713975b4-fa99-4c26-92cd-709f730d576c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:07.982607 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-713975b4-fa99-4c26-92cd-709f730d576c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:08.225309 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-713975b4-fa99-4c26-92cd-709f730d576c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:08.239861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-713975b4-fa99-4c26-92cd-709f730d576c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.274682 Jul 20 08:27:08.242887 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 118/237] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:07 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:08.302048 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-55f23ba6-258e-447d-b1c4-7888d88baa92 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:08.303326 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-55f23ba6-258e-447d-b1c4-7888d88baa92 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:08.312814 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-55f23ba6-258e-447d-b1c4-7888d88baa92 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:08.313737 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-55f23ba6-258e-447d-b1c4-7888d88baa92 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:08.314552 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-55f23ba6-258e-447d-b1c4-7888d88baa92 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:08.315017 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-55f23ba6-258e-447d-b1c4-7888d88baa92 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:08.567410 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-55f23ba6-258e-447d-b1c4-7888d88baa92 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:08.582155 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-55f23ba6-258e-447d-b1c4-7888d88baa92 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.288689 Jul 20 08:27:08.583630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 120/238] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:08 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:08.632077 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c9dcfebf-0054-48e9-a854-53d5fa758a05 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:08.632784 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c9dcfebf-0054-48e9-a854-53d5fa758a05 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:08.635199 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:27:08.641489 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c9dcfebf-0054-48e9-a854-53d5fa758a05 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:08.642028 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c9dcfebf-0054-48e9-a854-53d5fa758a05 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:08.642984 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c9dcfebf-0054-48e9-a854-53d5fa758a05 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:08.643632 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c9dcfebf-0054-48e9-a854-53d5fa758a05 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:08.764751 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0e0865cc-7e01-4825-8f83-8d9e6d808f48 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:08.766363 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0e0865cc-7e01-4825-8f83-8d9e6d808f48 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:08.774139 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0e0865cc-7e01-4825-8f83-8d9e6d808f48 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:08.774909 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0e0865cc-7e01-4825-8f83-8d9e6d808f48 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:08.775953 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0e0865cc-7e01-4825-8f83-8d9e6d808f48 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:08.776729 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0e0865cc-7e01-4825-8f83-8d9e6d808f48 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:08.865385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c9dcfebf-0054-48e9-a854-53d5fa758a05 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:08.877964 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c9dcfebf-0054-48e9-a854-53d5fa758a05 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.249463 Jul 20 08:27:08.879516 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 119/239] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:08 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:08.993671 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-0e0865cc-7e01-4825-8f83-8d9e6d808f48 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:09.021292 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0e0865cc-7e01-4825-8f83-8d9e6d808f48 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.262802 Jul 20 08:27:09.023073 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 121/240] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:08 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:09.263663 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-887f1b35-9218-4aec-8e9a-d3c2093c0321 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:09.264802 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-887f1b35-9218-4aec-8e9a-d3c2093c0321 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:09.277449 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-887f1b35-9218-4aec-8e9a-d3c2093c0321 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:09.278190 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-887f1b35-9218-4aec-8e9a-d3c2093c0321 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:09.279746 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-887f1b35-9218-4aec-8e9a-d3c2093c0321 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:09.280873 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-887f1b35-9218-4aec-8e9a-d3c2093c0321 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:09.509149 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-887f1b35-9218-4aec-8e9a-d3c2093c0321 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:09.529770 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-887f1b35-9218-4aec-8e9a-d3c2093c0321 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.273001 Jul 20 08:27:09.534641 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 120/241] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:09 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:09.602420 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-784eb68e-2386-440a-8bb7-256ccc41e3f0 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:09.603571 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-784eb68e-2386-440a-8bb7-256ccc41e3f0 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:09.613567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-784eb68e-2386-440a-8bb7-256ccc41e3f0 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:09.614223 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-784eb68e-2386-440a-8bb7-256ccc41e3f0 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:09.615757 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-784eb68e-2386-440a-8bb7-256ccc41e3f0 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:09.616389 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-784eb68e-2386-440a-8bb7-256ccc41e3f0 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:09.911302 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-784eb68e-2386-440a-8bb7-256ccc41e3f0 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:09.913631 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d5680e4c-cc99-4a9f-b8ec-83bde24cf5ae tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:09.915154 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d5680e4c-cc99-4a9f-b8ec-83bde24cf5ae tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:09.922304 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-784eb68e-2386-440a-8bb7-256ccc41e3f0 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.324162 Jul 20 08:27:09.924090 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 122/242] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:09 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:09.932761 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d5680e4c-cc99-4a9f-b8ec-83bde24cf5ae tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:09.933910 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d5680e4c-cc99-4a9f-b8ec-83bde24cf5ae tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:09.934823 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d5680e4c-cc99-4a9f-b8ec-83bde24cf5ae tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:09.935345 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d5680e4c-cc99-4a9f-b8ec-83bde24cf5ae tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:10.050984 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9077967e-ebf2-4897-b445-f3f372824915 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:10.052144 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9077967e-ebf2-4897-b445-f3f372824915 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:10.058716 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9077967e-ebf2-4897-b445-f3f372824915 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:10.059983 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9077967e-ebf2-4897-b445-f3f372824915 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:10.060821 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9077967e-ebf2-4897-b445-f3f372824915 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:10.061253 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9077967e-ebf2-4897-b445-f3f372824915 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:10.149927 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d5680e4c-cc99-4a9f-b8ec-83bde24cf5ae tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:10.164573 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d5680e4c-cc99-4a9f-b8ec-83bde24cf5ae tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.270916 Jul 20 08:27:10.165664 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 121/243] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:09 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:10.265594 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9077967e-ebf2-4897-b445-f3f372824915 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:10.293943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9077967e-ebf2-4897-b445-f3f372824915 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.249134 Jul 20 08:27:10.295006 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 123/244] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:10 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:10.557251 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6871438d-d409-41f7-b9bd-3b92fdaa7c5f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:10.557970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6871438d-d409-41f7-b9bd-3b92fdaa7c5f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:10.568074 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6871438d-d409-41f7-b9bd-3b92fdaa7c5f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:10.568837 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6871438d-d409-41f7-b9bd-3b92fdaa7c5f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:10.571041 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6871438d-d409-41f7-b9bd-3b92fdaa7c5f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:10.572208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6871438d-d409-41f7-b9bd-3b92fdaa7c5f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:10.601953 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:27:10.809390 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6871438d-d409-41f7-b9bd-3b92fdaa7c5f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:10.819420 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6871438d-d409-41f7-b9bd-3b92fdaa7c5f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.269054 Jul 20 08:27:10.820395 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 122/245] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:10 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:10.948879 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-95ac950b-cd44-4c84-8de8-e98907d3abdb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:10.950173 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-95ac950b-cd44-4c84-8de8-e98907d3abdb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:10.956808 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-95ac950b-cd44-4c84-8de8-e98907d3abdb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:10.957333 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-95ac950b-cd44-4c84-8de8-e98907d3abdb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:10.958142 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-95ac950b-cd44-4c84-8de8-e98907d3abdb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:10.958683 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-95ac950b-cd44-4c84-8de8-e98907d3abdb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:11.170266 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-95ac950b-cd44-4c84-8de8-e98907d3abdb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:11.186072 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-95ac950b-cd44-4c84-8de8-e98907d3abdb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.240763 Jul 20 08:27:11.196326 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f35ff59d-60c5-4bbe-89b1-29b41067f365 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:11.197496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f35ff59d-60c5-4bbe-89b1-29b41067f365 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:11.215122 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 124/246] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:10 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:11.215682 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f35ff59d-60c5-4bbe-89b1-29b41067f365 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:11.216773 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f35ff59d-60c5-4bbe-89b1-29b41067f365 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:11.218570 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f35ff59d-60c5-4bbe-89b1-29b41067f365 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:11.219590 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f35ff59d-60c5-4bbe-89b1-29b41067f365 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:11.334014 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7afd5f82-3edf-4a89-8049-605b234c8850 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:11.335257 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-7afd5f82-3edf-4a89-8049-605b234c8850 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:11.365275 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7afd5f82-3edf-4a89-8049-605b234c8850 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:11.369695 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7afd5f82-3edf-4a89-8049-605b234c8850 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:11.373511 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7afd5f82-3edf-4a89-8049-605b234c8850 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:11.374517 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7afd5f82-3edf-4a89-8049-605b234c8850 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:11.410496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f35ff59d-60c5-4bbe-89b1-29b41067f365 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:11.430961 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f35ff59d-60c5-4bbe-89b1-29b41067f365 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.241349 Jul 20 08:27:11.431752 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 123/247] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:11 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:11.617465 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-7afd5f82-3edf-4a89-8049-605b234c8850 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:11.626666 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-7afd5f82-3edf-4a89-8049-605b234c8850 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1314 microversion: 2.1 time: 0.306402 Jul 20 08:27:11.627872 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 125/248] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:11 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:11.837877 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-b69789f9-ccd6-44fe-bca5-70d274406eec tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:11.838692 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-b69789f9-ccd6-44fe-bca5-70d274406eec tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:11.850259 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b69789f9-ccd6-44fe-bca5-70d274406eec tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:11.850765 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b69789f9-ccd6-44fe-bca5-70d274406eec tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:11.851577 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b69789f9-ccd6-44fe-bca5-70d274406eec tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:11.852003 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b69789f9-ccd6-44fe-bca5-70d274406eec tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:12.151634 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b69789f9-ccd6-44fe-bca5-70d274406eec tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:12.165450 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-b69789f9-ccd6-44fe-bca5-70d274406eec tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.331327 Jul 20 08:27:12.167069 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 124/249] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:11 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:12.229729 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-bcad78a3-1df1-4e25-8200-3c02148b7306 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:12.230619 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-bcad78a3-1df1-4e25-8200-3c02148b7306 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:12.241505 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bcad78a3-1df1-4e25-8200-3c02148b7306 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:12.242020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bcad78a3-1df1-4e25-8200-3c02148b7306 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:12.243369 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bcad78a3-1df1-4e25-8200-3c02148b7306 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:12.244006 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bcad78a3-1df1-4e25-8200-3c02148b7306 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:12.458074 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f50c40d1-9fc6-4616-b270-cc83f3398f0d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:12.459144 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f50c40d1-9fc6-4616-b270-cc83f3398f0d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:12.463968 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-bcad78a3-1df1-4e25-8200-3c02148b7306 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:12.475977 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-bcad78a3-1df1-4e25-8200-3c02148b7306 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.250418 Jul 20 08:27:12.476576 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 126/250] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:12 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:12.477972 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f50c40d1-9fc6-4616-b270-cc83f3398f0d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:12.478980 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f50c40d1-9fc6-4616-b270-cc83f3398f0d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:12.480538 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f50c40d1-9fc6-4616-b270-cc83f3398f0d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:12.481832 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f50c40d1-9fc6-4616-b270-cc83f3398f0d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:12.646829 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d040b556-8ca4-4e19-99e9-d5d4c023f656 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:12.647443 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d040b556-8ca4-4e19-99e9-d5d4c023f656 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:12.654242 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d040b556-8ca4-4e19-99e9-d5d4c023f656 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:12.654724 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d040b556-8ca4-4e19-99e9-d5d4c023f656 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:12.655522 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d040b556-8ca4-4e19-99e9-d5d4c023f656 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:12.656499 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d040b556-8ca4-4e19-99e9-d5d4c023f656 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:12.742403 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f50c40d1-9fc6-4616-b270-cc83f3398f0d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:12.754215 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f50c40d1-9fc6-4616-b270-cc83f3398f0d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.300136 Jul 20 08:27:12.757143 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 125/251] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:12 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:12.905397 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d040b556-8ca4-4e19-99e9-d5d4c023f656 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:12.916073 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d040b556-8ca4-4e19-99e9-d5d4c023f656 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1502 microversion: 2.1 time: 0.275120 Jul 20 08:27:12.916661 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 127/252] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:12 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1502 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:13.188557 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-807961f4-a14c-458a-83a5-bd0564c943ee tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:13.189864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-807961f4-a14c-458a-83a5-bd0564c943ee tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:13.198024 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-807961f4-a14c-458a-83a5-bd0564c943ee tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:13.198756 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-807961f4-a14c-458a-83a5-bd0564c943ee tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:13.200115 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-807961f4-a14c-458a-83a5-bd0564c943ee tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:13.200592 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-807961f4-a14c-458a-83a5-bd0564c943ee tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:13.508128 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-86840e3f-bb70-4c42-b3c0-23ec2322637a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:13.511190 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-86840e3f-bb70-4c42-b3c0-23ec2322637a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:13.529386 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-86840e3f-bb70-4c42-b3c0-23ec2322637a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:13.530558 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-86840e3f-bb70-4c42-b3c0-23ec2322637a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:13.532589 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-86840e3f-bb70-4c42-b3c0-23ec2322637a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:13.533684 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-86840e3f-bb70-4c42-b3c0-23ec2322637a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:13.802813 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-807961f4-a14c-458a-83a5-bd0564c943ee tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:13.810467 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-86840e3f-bb70-4c42-b3c0-23ec2322637a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:13.813909 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-807961f4-a14c-458a-83a5-bd0564c943ee tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.632883 Jul 20 08:27:13.815235 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 126/253] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:13 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:13.844681 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f59d7586-7c9a-4f7b-a6a4-29efe5789a0c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:13.845697 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f59d7586-7c9a-4f7b-a6a4-29efe5789a0c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:13.852840 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-86840e3f-bb70-4c42-b3c0-23ec2322637a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.353439 Jul 20 08:27:13.854134 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 128/254] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:13 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:13.879855 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f59d7586-7c9a-4f7b-a6a4-29efe5789a0c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:13.880866 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f59d7586-7c9a-4f7b-a6a4-29efe5789a0c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:13.882392 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f59d7586-7c9a-4f7b-a6a4-29efe5789a0c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:13.883153 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f59d7586-7c9a-4f7b-a6a4-29efe5789a0c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:14.079809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f59d7586-7c9a-4f7b-a6a4-29efe5789a0c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:14.088215 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f59d7586-7c9a-4f7b-a6a4-29efe5789a0c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.271012 Jul 20 08:27:14.088835 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 127/255] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:13 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:14.839809 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e3339722-86fc-49cf-8a0d-5139ea76b433 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:14.840405 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-e3339722-86fc-49cf-8a0d-5139ea76b433 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:14.848185 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e3339722-86fc-49cf-8a0d-5139ea76b433 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:14.848637 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e3339722-86fc-49cf-8a0d-5139ea76b433 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:14.849420 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e3339722-86fc-49cf-8a0d-5139ea76b433 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:14.849852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e3339722-86fc-49cf-8a0d-5139ea76b433 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:14.881861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-df90811f-fb42-46ae-9c27-06303369e428 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:14.882461 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-df90811f-fb42-46ae-9c27-06303369e428 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:14.890861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-df90811f-fb42-46ae-9c27-06303369e428 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:14.891311 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-df90811f-fb42-46ae-9c27-06303369e428 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:14.892109 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-df90811f-fb42-46ae-9c27-06303369e428 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:14.892546 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-df90811f-fb42-46ae-9c27-06303369e428 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:15.050505 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e3339722-86fc-49cf-8a0d-5139ea76b433 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:15.058616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e3339722-86fc-49cf-8a0d-5139ea76b433 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.222590 Jul 20 08:27:15.059255 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 129/256] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:14 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:15.084706 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-df90811f-fb42-46ae-9c27-06303369e428 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:15.093994 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-df90811f-fb42-46ae-9c27-06303369e428 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.215719 Jul 20 08:27:15.094523 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 128/257] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:14 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:15.111052 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d3d0bd7e-0ca3-470d-a6e6-b771fc3107fa tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:15.111966 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d3d0bd7e-0ca3-470d-a6e6-b771fc3107fa tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:15.118478 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d3d0bd7e-0ca3-470d-a6e6-b771fc3107fa tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:15.118959 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d3d0bd7e-0ca3-470d-a6e6-b771fc3107fa tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:15.119757 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d3d0bd7e-0ca3-470d-a6e6-b771fc3107fa tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:15.120192 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d3d0bd7e-0ca3-470d-a6e6-b771fc3107fa tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:15.136961 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=100 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:27:15.269725 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d3d0bd7e-0ca3-470d-a6e6-b771fc3107fa tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:15.278189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d3d0bd7e-0ca3-470d-a6e6-b771fc3107fa tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.172609 Jul 20 08:27:15.278914 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 130/258] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:15 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:16.076284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-60df134c-8365-4a41-b6d4-0c6961f52353 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:16.076950 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-60df134c-8365-4a41-b6d4-0c6961f52353 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:16.084106 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-60df134c-8365-4a41-b6d4-0c6961f52353 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:16.084520 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-60df134c-8365-4a41-b6d4-0c6961f52353 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:16.085297 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-60df134c-8365-4a41-b6d4-0c6961f52353 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:16.085761 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-60df134c-8365-4a41-b6d4-0c6961f52353 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:16.112992 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-78545efc-3643-4555-b577-68416461b2dc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:16.113973 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-78545efc-3643-4555-b577-68416461b2dc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:16.121253 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-78545efc-3643-4555-b577-68416461b2dc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:16.121694 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-78545efc-3643-4555-b577-68416461b2dc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:16.122488 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-78545efc-3643-4555-b577-68416461b2dc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:16.122963 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-78545efc-3643-4555-b577-68416461b2dc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:16.273540 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-78545efc-3643-4555-b577-68416461b2dc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:16.284479 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-78545efc-3643-4555-b577-68416461b2dc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.176093 Jul 20 08:27:16.285328 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 131/259] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:16 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:16.294567 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-60df134c-8365-4a41-b6d4-0c6961f52353 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:16.295692 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7af2dcb6-1274-4e57-b3cd-67d09446bc98 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:16.296303 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-7af2dcb6-1274-4e57-b3cd-67d09446bc98 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:16.303985 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7af2dcb6-1274-4e57-b3cd-67d09446bc98 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:16.304598 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7af2dcb6-1274-4e57-b3cd-67d09446bc98 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:16.305478 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7af2dcb6-1274-4e57-b3cd-67d09446bc98 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:16.305889 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-60df134c-8365-4a41-b6d4-0c6961f52353 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.233161 Jul 20 08:27:16.306027 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7af2dcb6-1274-4e57-b3cd-67d09446bc98 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:16.306909 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 129/260] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:16 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:16.465367 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-7af2dcb6-1274-4e57-b3cd-67d09446bc98 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:16.474567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-7af2dcb6-1274-4e57-b3cd-67d09446bc98 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.182514 Jul 20 08:27:16.475240 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 132/261] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:16 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:17.311067 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4624cc2a-87f2-4ec0-80fd-78c2e3aa9c55 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:17.311664 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4624cc2a-87f2-4ec0-80fd-78c2e3aa9c55 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:17.318378 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4624cc2a-87f2-4ec0-80fd-78c2e3aa9c55 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:17.318840 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4624cc2a-87f2-4ec0-80fd-78c2e3aa9c55 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:17.319604 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4624cc2a-87f2-4ec0-80fd-78c2e3aa9c55 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:17.320031 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4624cc2a-87f2-4ec0-80fd-78c2e3aa9c55 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:17.325339 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1300a82a-7bcd-4aae-8c2c-79806d4b8602 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:17.326388 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1300a82a-7bcd-4aae-8c2c-79806d4b8602 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:17.336065 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1300a82a-7bcd-4aae-8c2c-79806d4b8602 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:17.336797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1300a82a-7bcd-4aae-8c2c-79806d4b8602 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:17.338120 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1300a82a-7bcd-4aae-8c2c-79806d4b8602 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:17.338887 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1300a82a-7bcd-4aae-8c2c-79806d4b8602 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:17.486689 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1300a82a-7bcd-4aae-8c2c-79806d4b8602 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:17.493017 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4624cc2a-87f2-4ec0-80fd-78c2e3aa9c55 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:17.494531 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1300a82a-7bcd-4aae-8c2c-79806d4b8602 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.173406 Jul 20 08:27:17.495136 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 133/262] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:17 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:17.499581 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a01d6337-4c33-4ec9-800c-17cf02c49784 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:17.500231 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a01d6337-4c33-4ec9-800c-17cf02c49784 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:17.507522 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a01d6337-4c33-4ec9-800c-17cf02c49784 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:17.508006 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a01d6337-4c33-4ec9-800c-17cf02c49784 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:17.508707 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a01d6337-4c33-4ec9-800c-17cf02c49784 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:17.509350 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a01d6337-4c33-4ec9-800c-17cf02c49784 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:17.509802 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4624cc2a-87f2-4ec0-80fd-78c2e3aa9c55 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.202518 Jul 20 08:27:17.510395 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 130/263] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:17 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:17.658518 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a01d6337-4c33-4ec9-800c-17cf02c49784 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:17.668957 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a01d6337-4c33-4ec9-800c-17cf02c49784 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.172588 Jul 20 08:27:17.669403 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 134/264] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:17 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:18.511830 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e51a8c4b-8fb7-4198-bf02-b6479400bbab tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:18.512432 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e51a8c4b-8fb7-4198-bf02-b6479400bbab tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:18.519420 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e51a8c4b-8fb7-4198-bf02-b6479400bbab tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:18.519871 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e51a8c4b-8fb7-4198-bf02-b6479400bbab tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:18.520870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e51a8c4b-8fb7-4198-bf02-b6479400bbab tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:18.521312 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e51a8c4b-8fb7-4198-bf02-b6479400bbab tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:18.533222 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c6cf542d-dc58-4344-86c6-ad9a18f1246f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:18.535263 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c6cf542d-dc58-4344-86c6-ad9a18f1246f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:18.546976 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c6cf542d-dc58-4344-86c6-ad9a18f1246f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:18.548280 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c6cf542d-dc58-4344-86c6-ad9a18f1246f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:18.550034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c6cf542d-dc58-4344-86c6-ad9a18f1246f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:18.550927 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c6cf542d-dc58-4344-86c6-ad9a18f1246f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:18.709584 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e51a8c4b-8fb7-4198-bf02-b6479400bbab tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:18.731767 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e51a8c4b-8fb7-4198-bf02-b6479400bbab tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1365 microversion: 2.1 time: 0.223083 Jul 20 08:27:18.733293 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 131/265] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:18 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:18.752812 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5816b3fb-7225-4575-ae40-0f791511631f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:18.754572 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5816b3fb-7225-4575-ae40-0f791511631f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:18.774259 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5816b3fb-7225-4575-ae40-0f791511631f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:18.775176 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c6cf542d-dc58-4344-86c6-ad9a18f1246f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:18.775969 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5816b3fb-7225-4575-ae40-0f791511631f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:18.777808 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5816b3fb-7225-4575-ae40-0f791511631f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:18.778856 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5816b3fb-7225-4575-ae40-0f791511631f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:18.787383 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c6cf542d-dc58-4344-86c6-ad9a18f1246f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.261630 Jul 20 08:27:18.788622 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 135/266] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:18 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:18.809569 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-18ce76d6-b9e4-4518-8cca-3ab3a3dedecf req-7d1d75bd-bac6-4731-8039-ed880147d9dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c374291c-87f7-45dd-9391-807207d937bc", "name": "network-vif-plugged", "status": "completed", "tag": "90d4b267-6b9e-479b-978c-9e4434caa2b0"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:27:18.827516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-18ce76d6-b9e4-4518-8cca-3ab3a3dedecf req-7d1d75bd-bac6-4731-8039-ed880147d9dc service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:18.830545 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-18ce76d6-b9e4-4518-8cca-3ab3a3dedecf req-7d1d75bd-bac6-4731-8039-ed880147d9dc service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:18.864514 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-18ce76d6-b9e4-4518-8cca-3ab3a3dedecf req-7d1d75bd-bac6-4731-8039-ed880147d9dc service nova] Creating event network-vif-plugged:90d4b267-6b9e-479b-978c-9e4434caa2b0 for instance c374291c-87f7-45dd-9391-807207d937bc on hv-cinder-82308 Jul 20 08:27:18.870704 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-18ce76d6-b9e4-4518-8cca-3ab3a3dedecf req-7d1d75bd-bac6-4731-8039-ed880147d9dc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078873 Jul 20 08:27:18.871313 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 136/267] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:27:18.975070 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5816b3fb-7225-4575-ae40-0f791511631f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:18.982546 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5816b3fb-7225-4575-ae40-0f791511631f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.247342 Jul 20 08:27:18.983152 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 132/268] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:18 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:19.759363 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9a325dcc-3d2d-4916-a387-f007e36ce955 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:19.760518 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9a325dcc-3d2d-4916-a387-f007e36ce955 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:19.772600 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9a325dcc-3d2d-4916-a387-f007e36ce955 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:19.773471 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9a325dcc-3d2d-4916-a387-f007e36ce955 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:19.774822 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9a325dcc-3d2d-4916-a387-f007e36ce955 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:19.775449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9a325dcc-3d2d-4916-a387-f007e36ce955 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:19.808955 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a2220e5f-98d3-4017-9c8d-31b385056650 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:19.809359 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a2220e5f-98d3-4017-9c8d-31b385056650 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:19.816388 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a2220e5f-98d3-4017-9c8d-31b385056650 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:19.816884 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a2220e5f-98d3-4017-9c8d-31b385056650 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:19.817657 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a2220e5f-98d3-4017-9c8d-31b385056650 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:19.818139 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a2220e5f-98d3-4017-9c8d-31b385056650 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:20.052823 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a2220e5f-98d3-4017-9c8d-31b385056650 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:20.061131 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a2220e5f-98d3-4017-9c8d-31b385056650 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.259374 Jul 20 08:27:20.061722 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 133/269] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:19 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:20.067414 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-95948dbd-a460-4461-ab45-18fe426307af tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:20.068016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-95948dbd-a460-4461-ab45-18fe426307af tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:20.074894 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-95948dbd-a460-4461-ab45-18fe426307af tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:20.075343 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-95948dbd-a460-4461-ab45-18fe426307af tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:20.076278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-95948dbd-a460-4461-ab45-18fe426307af tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:20.076715 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-95948dbd-a460-4461-ab45-18fe426307af tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:20.197302 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9a325dcc-3d2d-4916-a387-f007e36ce955 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:20.208143 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9a325dcc-3d2d-4916-a387-f007e36ce955 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1554 microversion: 2.1 time: 0.456625 Jul 20 08:27:20.208858 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 137/270] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:19 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1554 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:20.236381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-95948dbd-a460-4461-ab45-18fe426307af tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:20.244236 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b7d4bf0f-d419-495e-a2f0-ad7c729cfc54 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:20.245430 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b7d4bf0f-d419-495e-a2f0-ad7c729cfc54 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:20.252823 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b7d4bf0f-d419-495e-a2f0-ad7c729cfc54 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:20.255697 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b7d4bf0f-d419-495e-a2f0-ad7c729cfc54 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:20.257028 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-95948dbd-a460-4461-ab45-18fe426307af tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.192752 Jul 20 08:27:20.257571 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b7d4bf0f-d419-495e-a2f0-ad7c729cfc54 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:20.258168 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b7d4bf0f-d419-495e-a2f0-ad7c729cfc54 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:20.258670 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 134/271] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:20 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:20.405065 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b7d4bf0f-d419-495e-a2f0-ad7c729cfc54 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164778 Jul 20 08:27:20.405806 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 138/272] 10.222.0.64 () {58 vars in 1274 bytes} [Wed Jul 20 08:27:20 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:27:21.023632 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-0b802ca2-30a6-4ec2-8447-cf8a272020bb tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "453ea295-7728-4dfc-93ce-b6c3ebcb1387"}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:27:21.024780 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-0b802ca2-30a6-4ec2-8447-cf8a272020bb tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:21.031731 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0b802ca2-30a6-4ec2-8447-cf8a272020bb tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:21.032417 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0b802ca2-30a6-4ec2-8447-cf8a272020bb tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:21.033192 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0b802ca2-30a6-4ec2-8447-cf8a272020bb tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:21.033786 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0b802ca2-30a6-4ec2-8447-cf8a272020bb tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:21.081330 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-2fc7e5e5-f1c1-4538-8636-8b9950e569c7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:21.082775 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-2fc7e5e5-f1c1-4538-8636-8b9950e569c7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:21.090185 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2fc7e5e5-f1c1-4538-8636-8b9950e569c7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:21.091235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2fc7e5e5-f1c1-4538-8636-8b9950e569c7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:21.092260 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2fc7e5e5-f1c1-4538-8636-8b9950e569c7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:21.093080 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2fc7e5e5-f1c1-4538-8636-8b9950e569c7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:21.370176 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2fc7e5e5-f1c1-4538-8636-8b9950e569c7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:21.385773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-2fc7e5e5-f1c1-4538-8636-8b9950e569c7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.308962 Jul 20 08:27:21.409704 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 139/273] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:21 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:21.420530 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-04c1ee92-65f8-4216-91f4-cc448976ba12 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:21.421802 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-04c1ee92-65f8-4216-91f4-cc448976ba12 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:21.441466 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-04c1ee92-65f8-4216-91f4-cc448976ba12 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:21.441951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-04c1ee92-65f8-4216-91f4-cc448976ba12 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:21.443803 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-04c1ee92-65f8-4216-91f4-cc448976ba12 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:21.444275 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-04c1ee92-65f8-4216-91f4-cc448976ba12 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:21.720605 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-0b802ca2-30a6-4ec2-8447-cf8a272020bb tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "POST /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.700723 Jul 20 08:27:21.721225 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 135/274] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Jul 20 08:27:21 2022] POST /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d/os-volume_attachments => generated 194 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:27:21.735738 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-ca25edec-09ab-4292-9333-b949bb0e27a1 req-306f134b-9d8a-4eea-b9cb-973227b214ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "659d1d17-9163-4971-9ba1-40f3f20d2650", "tag": "e37caaf1-6167-4ebe-94cd-55ea929f139d"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:27:21.752388 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-ca25edec-09ab-4292-9333-b949bb0e27a1 req-306f134b-9d8a-4eea-b9cb-973227b214ed service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:21.753457 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-ca25edec-09ab-4292-9333-b949bb0e27a1 req-306f134b-9d8a-4eea-b9cb-973227b214ed service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:21.769295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-ca25edec-09ab-4292-9333-b949bb0e27a1 req-306f134b-9d8a-4eea-b9cb-973227b214ed service nova] Creating event network-changed:e37caaf1-6167-4ebe-94cd-55ea929f139d for instance 659d1d17-9163-4971-9ba1-40f3f20d2650 on hv-cinder-82308 Jul 20 08:27:21.775331 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-ca25edec-09ab-4292-9333-b949bb0e27a1 req-306f134b-9d8a-4eea-b9cb-973227b214ed service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046109 Jul 20 08:27:21.776764 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 136/275] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:27:21.795837 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-04c1ee92-65f8-4216-91f4-cc448976ba12 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:21.806784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-04c1ee92-65f8-4216-91f4-cc448976ba12 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.394531 Jul 20 08:27:21.807566 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 140/276] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:21 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:22.417815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4eec19c6-30cf-4b35-ae9b-50a381455ac2 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:22.418800 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4eec19c6-30cf-4b35-ae9b-50a381455ac2 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:22.425885 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4eec19c6-30cf-4b35-ae9b-50a381455ac2 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:22.426560 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4eec19c6-30cf-4b35-ae9b-50a381455ac2 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:22.427382 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4eec19c6-30cf-4b35-ae9b-50a381455ac2 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:22.427809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4eec19c6-30cf-4b35-ae9b-50a381455ac2 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:22.695099 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4eec19c6-30cf-4b35-ae9b-50a381455ac2 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:22.710018 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4eec19c6-30cf-4b35-ae9b-50a381455ac2 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.294048 Jul 20 08:27:22.711344 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 137/277] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:22 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:22.833604 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-fe50d2e9-6c9e-4527-b91c-10c853144416 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:22.834475 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-fe50d2e9-6c9e-4527-b91c-10c853144416 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:22.842276 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fe50d2e9-6c9e-4527-b91c-10c853144416 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:22.843115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fe50d2e9-6c9e-4527-b91c-10c853144416 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:22.844256 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fe50d2e9-6c9e-4527-b91c-10c853144416 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:22.845071 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fe50d2e9-6c9e-4527-b91c-10c853144416 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:23.095845 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-fe50d2e9-6c9e-4527-b91c-10c853144416 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:23.115743 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-fe50d2e9-6c9e-4527-b91c-10c853144416 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1362 microversion: 2.1 time: 0.286134 Jul 20 08:27:23.116336 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 141/278] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:22 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:23.733873 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-73f5da57-9fd8-429a-b72e-1e7854d44618 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:23.735142 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-73f5da57-9fd8-429a-b72e-1e7854d44618 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:23.751029 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-73f5da57-9fd8-429a-b72e-1e7854d44618 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:23.751475 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-73f5da57-9fd8-429a-b72e-1e7854d44618 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:23.752405 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-73f5da57-9fd8-429a-b72e-1e7854d44618 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:23.752718 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-73f5da57-9fd8-429a-b72e-1e7854d44618 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:23.782244 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:27:23.949208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-73f5da57-9fd8-429a-b72e-1e7854d44618 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:23.958510 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-73f5da57-9fd8-429a-b72e-1e7854d44618 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.232808 Jul 20 08:27:23.959412 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 138/279] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:23 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:24.138966 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d8da1b0d-48c6-4cb9-9345-c5fc82d84b61 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:24.141520 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d8da1b0d-48c6-4cb9-9345-c5fc82d84b61 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:24.154304 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d8da1b0d-48c6-4cb9-9345-c5fc82d84b61 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:24.155336 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d8da1b0d-48c6-4cb9-9345-c5fc82d84b61 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:24.157030 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d8da1b0d-48c6-4cb9-9345-c5fc82d84b61 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:24.157806 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d8da1b0d-48c6-4cb9-9345-c5fc82d84b61 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:24.441139 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d8da1b0d-48c6-4cb9-9345-c5fc82d84b61 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:24.449819 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d8da1b0d-48c6-4cb9-9345-c5fc82d84b61 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1548 microversion: 2.1 time: 0.319664 Jul 20 08:27:24.458796 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 142/280] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:24 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1548 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:24.469996 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a97f0085-71bf-4494-9fce-4dfef291a28b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:24.470242 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a97f0085-71bf-4494-9fce-4dfef291a28b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:24.476820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a97f0085-71bf-4494-9fce-4dfef291a28b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:24.477256 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a97f0085-71bf-4494-9fce-4dfef291a28b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:24.478063 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a97f0085-71bf-4494-9fce-4dfef291a28b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:24.478500 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a97f0085-71bf-4494-9fce-4dfef291a28b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:24.591159 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a97f0085-71bf-4494-9fce-4dfef291a28b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.125446 Jul 20 08:27:24.591866 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 139/281] 10.222.0.64 () {58 vars in 1274 bytes} [Wed Jul 20 08:27:24 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:27:24.977658 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-4039a3aa-7068-495e-99ce-50c7d94fa771 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:24.978431 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-4039a3aa-7068-495e-99ce-50c7d94fa771 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:24.985804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4039a3aa-7068-495e-99ce-50c7d94fa771 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:24.986249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4039a3aa-7068-495e-99ce-50c7d94fa771 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:24.987243 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4039a3aa-7068-495e-99ce-50c7d94fa771 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:24.988414 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4039a3aa-7068-495e-99ce-50c7d94fa771 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:25.223073 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-4039a3aa-7068-495e-99ce-50c7d94fa771 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:25.235991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-4039a3aa-7068-495e-99ce-50c7d94fa771 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.261683 Jul 20 08:27:25.238285 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 143/282] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:24 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:26.254725 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-bdb30eac-92fd-45c6-abca-1e3649ddb53d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:26.256070 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-bdb30eac-92fd-45c6-abca-1e3649ddb53d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:26.264215 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bdb30eac-92fd-45c6-abca-1e3649ddb53d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:26.268098 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bdb30eac-92fd-45c6-abca-1e3649ddb53d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:26.268958 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bdb30eac-92fd-45c6-abca-1e3649ddb53d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:26.269392 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bdb30eac-92fd-45c6-abca-1e3649ddb53d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:26.385824 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-22593e34-fb87-4d68-bdff-84aefc5b6bf4 req-82cb976e-d5fa-4ba9-b678-8319cf54ec98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c374291c-87f7-45dd-9391-807207d937bc", "tag": "90d4b267-6b9e-479b-978c-9e4434caa2b0"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:27:26.413668 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-22593e34-fb87-4d68-bdff-84aefc5b6bf4 req-82cb976e-d5fa-4ba9-b678-8319cf54ec98 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:26.414564 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-22593e34-fb87-4d68-bdff-84aefc5b6bf4 req-82cb976e-d5fa-4ba9-b678-8319cf54ec98 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:26.427886 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-22593e34-fb87-4d68-bdff-84aefc5b6bf4 req-82cb976e-d5fa-4ba9-b678-8319cf54ec98 service nova] Creating event network-changed:90d4b267-6b9e-479b-978c-9e4434caa2b0 for instance c374291c-87f7-45dd-9391-807207d937bc on hv-cinder-82308 Jul 20 08:27:26.433882 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-22593e34-fb87-4d68-bdff-84aefc5b6bf4 req-82cb976e-d5fa-4ba9-b678-8319cf54ec98 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056660 Jul 20 08:27:26.435185 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 144/283] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:27:26.502074 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-bdb30eac-92fd-45c6-abca-1e3649ddb53d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:26.513922 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-bdb30eac-92fd-45c6-abca-1e3649ddb53d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.263457 Jul 20 08:27:26.530341 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 140/284] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:26 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:27.538753 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e12f8748-b36e-4a11-9c0b-2bc26424e414 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:27.539964 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-e12f8748-b36e-4a11-9c0b-2bc26424e414 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:27.546058 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e12f8748-b36e-4a11-9c0b-2bc26424e414 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:27.547169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e12f8748-b36e-4a11-9c0b-2bc26424e414 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:27.548150 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e12f8748-b36e-4a11-9c0b-2bc26424e414 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:27.548654 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e12f8748-b36e-4a11-9c0b-2bc26424e414 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:27.691996 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e12f8748-b36e-4a11-9c0b-2bc26424e414 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:27.700261 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e12f8748-b36e-4a11-9c0b-2bc26424e414 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.166455 Jul 20 08:27:27.700876 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 145/285] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:27 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:28.717568 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e9d43b4e-2a75-43a9-932d-6d211efce9bb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:28.718175 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e9d43b4e-2a75-43a9-932d-6d211efce9bb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:28.725170 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e9d43b4e-2a75-43a9-932d-6d211efce9bb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:28.725614 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e9d43b4e-2a75-43a9-932d-6d211efce9bb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:28.726374 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e9d43b4e-2a75-43a9-932d-6d211efce9bb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:28.726841 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e9d43b4e-2a75-43a9-932d-6d211efce9bb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:28.856945 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e9d43b4e-2a75-43a9-932d-6d211efce9bb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:28.865154 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e9d43b4e-2a75-43a9-932d-6d211efce9bb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.151475 Jul 20 08:27:28.865719 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 141/286] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:28 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:29.883815 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9a840dfa-8798-474d-8dc2-b5ea82b67de4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:29.885866 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9a840dfa-8798-474d-8dc2-b5ea82b67de4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:29.893141 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9a840dfa-8798-474d-8dc2-b5ea82b67de4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:29.893578 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9a840dfa-8798-474d-8dc2-b5ea82b67de4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:29.894348 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9a840dfa-8798-474d-8dc2-b5ea82b67de4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:29.894829 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9a840dfa-8798-474d-8dc2-b5ea82b67de4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:30.045743 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9a840dfa-8798-474d-8dc2-b5ea82b67de4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:30.053601 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9a840dfa-8798-474d-8dc2-b5ea82b67de4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.174926 Jul 20 08:27:30.054182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 146/287] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:29 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:31.072673 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c32a0f07-8683-4c63-8518-cb4a74068e8e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:31.073284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c32a0f07-8683-4c63-8518-cb4a74068e8e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:31.081166 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c32a0f07-8683-4c63-8518-cb4a74068e8e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:31.081765 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c32a0f07-8683-4c63-8518-cb4a74068e8e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:31.082554 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c32a0f07-8683-4c63-8518-cb4a74068e8e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:31.083090 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c32a0f07-8683-4c63-8518-cb4a74068e8e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:31.224917 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c32a0f07-8683-4c63-8518-cb4a74068e8e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:31.232534 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c32a0f07-8683-4c63-8518-cb4a74068e8e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.163733 Jul 20 08:27:31.233121 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 142/288] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:31 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:32.249881 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-4afd17e3-e2c6-4578-90f6-d33092032fee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:32.250761 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-4afd17e3-e2c6-4578-90f6-d33092032fee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:32.257562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4afd17e3-e2c6-4578-90f6-d33092032fee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:32.258012 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4afd17e3-e2c6-4578-90f6-d33092032fee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:32.258865 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4afd17e3-e2c6-4578-90f6-d33092032fee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:32.259307 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4afd17e3-e2c6-4578-90f6-d33092032fee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:32.399467 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-4afd17e3-e2c6-4578-90f6-d33092032fee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:32.408693 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-4afd17e3-e2c6-4578-90f6-d33092032fee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.162881 Jul 20 08:27:32.409346 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 147/289] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:32 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:33.429927 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-62ad78b1-5dd1-49a1-89dc-d1b33ffd9a8e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:33.430995 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-62ad78b1-5dd1-49a1-89dc-d1b33ffd9a8e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:33.442338 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-62ad78b1-5dd1-49a1-89dc-d1b33ffd9a8e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:33.443063 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-62ad78b1-5dd1-49a1-89dc-d1b33ffd9a8e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:33.444507 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-62ad78b1-5dd1-49a1-89dc-d1b33ffd9a8e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:33.445275 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-62ad78b1-5dd1-49a1-89dc-d1b33ffd9a8e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:33.667615 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-62ad78b1-5dd1-49a1-89dc-d1b33ffd9a8e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:33.675856 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-62ad78b1-5dd1-49a1-89dc-d1b33ffd9a8e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.253248 Jul 20 08:27:33.676444 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 143/290] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:33 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:33.822273 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-539d0609-978a-4ca9-a26a-7872f6ee5c17 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1082581719", "imageRef": "5d6b971e-8afe-4e4a-b054-20cd61970c65", "flavorRef": "452", "networks": [{"uuid": "9eed6757-1d3b-47bb-9daf-5c99f31991f4"}]}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:27:33.882423 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.network.neutron [None req-539d0609-978a-4ca9-a26a-7872f6ee5c17 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] validate_networks() for [('9eed6757-1d3b-47bb-9daf-5c99f31991f4', None, None, None, None, None)] {{(pid=117828) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:27:34.333674 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-539d0609-978a-4ca9-a26a-7872f6ee5c17 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Flavor limits 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:27:34.334090 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-539d0609-978a-4ca9-a26a-7872f6ee5c17 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Image limits 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:27:34.334552 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-539d0609-978a-4ca9-a26a-7872f6ee5c17 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Flavor pref 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:27:34.334985 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-539d0609-978a-4ca9-a26a-7872f6ee5c17 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Image pref 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:27:34.336281 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-539d0609-978a-4ca9-a26a-7872f6ee5c17 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:27:34.346433 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-539d0609-978a-4ca9-a26a-7872f6ee5c17 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:34.346896 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-539d0609-978a-4ca9-a26a-7872f6ee5c17 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:34.347687 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-539d0609-978a-4ca9-a26a-7872f6ee5c17 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:34.348118 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-539d0609-978a-4ca9-a26a-7872f6ee5c17 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:34.366550 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-539d0609-978a-4ca9-a26a-7872f6ee5c17 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Getting quotas for project 02622d333fa24a0bbd1ef6f59276ba77. Resources: {'cores', 'ram', 'instances'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:27:34.370552 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-539d0609-978a-4ca9-a26a-7872f6ee5c17 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Getting quotas for user d88c5f05aab0458d8dc0a285bce33f28 and project 02622d333fa24a0bbd1ef6f59276ba77. Resources: {'cores', 'ram', 'instances'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:27:34.382105 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-539d0609-978a-4ca9-a26a-7872f6ee5c17 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Going to run 1 instances... {{(pid=117828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:27:34.384398 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-539d0609-978a-4ca9-a26a-7872f6ee5c17 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d6b971e-8afe-4e4a-b054-20cd61970c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:27:34.432617 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-539d0609-978a-4ca9-a26a-7872f6ee5c17 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614055 Jul 20 08:27:34.433487 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 148/291] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Jul 20 08:27:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 08:27:34.443314 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-1ef75519-0e2e-45fc-a202-c5de1987b3d0 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:34.444013 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-1ef75519-0e2e-45fc-a202-c5de1987b3d0 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:34.503092 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1ef75519-0e2e-45fc-a202-c5de1987b3d0 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:34.510322 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-1ef75519-0e2e-45fc-a202-c5de1987b3d0 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1214 microversion: 2.1 time: 0.070728 Jul 20 08:27:34.510942 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 144/292] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:34 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:34.706800 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a7ba71ba-0cf3-480a-9d06-b30910a6a94b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:34.707978 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a7ba71ba-0cf3-480a-9d06-b30910a6a94b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:34.720284 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a7ba71ba-0cf3-480a-9d06-b30910a6a94b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:34.721252 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a7ba71ba-0cf3-480a-9d06-b30910a6a94b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:34.722765 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a7ba71ba-0cf3-480a-9d06-b30910a6a94b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:34.723611 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a7ba71ba-0cf3-480a-9d06-b30910a6a94b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:34.757790 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=100 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:27:34.995245 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a7ba71ba-0cf3-480a-9d06-b30910a6a94b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:35.010947 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a7ba71ba-0cf3-480a-9d06-b30910a6a94b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.314278 Jul 20 08:27:35.027814 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 149/293] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:34 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:35.527138 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-51ae9aba-2043-4f32-886b-47f4c3b10d04 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:35.527818 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-51ae9aba-2043-4f32-886b-47f4c3b10d04 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:35.537363 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-51ae9aba-2043-4f32-886b-47f4c3b10d04 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:35.538382 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-51ae9aba-2043-4f32-886b-47f4c3b10d04 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:35.539540 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-51ae9aba-2043-4f32-886b-47f4c3b10d04 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:35.540044 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-51ae9aba-2043-4f32-886b-47f4c3b10d04 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:35.630678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-51ae9aba-2043-4f32-886b-47f4c3b10d04 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:35.641483 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-51ae9aba-2043-4f32-886b-47f4c3b10d04 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1218 microversion: 2.1 time: 0.117951 Jul 20 08:27:35.642498 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 145/294] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:35 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:35.879459 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ecd7b9ee-d302-4e2d-9a3d-fefdf41175c4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:35.880041 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ecd7b9ee-d302-4e2d-9a3d-fefdf41175c4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:35.886499 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ecd7b9ee-d302-4e2d-9a3d-fefdf41175c4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:35.887431 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ecd7b9ee-d302-4e2d-9a3d-fefdf41175c4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:35.888198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ecd7b9ee-d302-4e2d-9a3d-fefdf41175c4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:35.888703 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ecd7b9ee-d302-4e2d-9a3d-fefdf41175c4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:35.915479 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ecd7b9ee-d302-4e2d-9a3d-fefdf41175c4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Going to try to terminate instance {{(pid=117828) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:27:36.014619 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ecd7b9ee-d302-4e2d-9a3d-fefdf41175c4 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "DELETE /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 204 len: 0 microversion: 2.1 time: 0.139004 Jul 20 08:27:36.015909 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 150/295] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:27:35 2022] DELETE /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:27:36.024034 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4a63b5ac-3e8a-4eef-acb2-abc2932ba889 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:36.024638 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4a63b5ac-3e8a-4eef-acb2-abc2932ba889 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:36.031460 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4a63b5ac-3e8a-4eef-acb2-abc2932ba889 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:36.032237 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4a63b5ac-3e8a-4eef-acb2-abc2932ba889 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:36.033048 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4a63b5ac-3e8a-4eef-acb2-abc2932ba889 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:36.033553 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4a63b5ac-3e8a-4eef-acb2-abc2932ba889 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:36.035761 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0fe0effc-95ad-4a08-a9db-0291e2914e74 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:36.036448 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0fe0effc-95ad-4a08-a9db-0291e2914e74 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:36.042381 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0fe0effc-95ad-4a08-a9db-0291e2914e74 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:36.042860 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0fe0effc-95ad-4a08-a9db-0291e2914e74 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:36.043626 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0fe0effc-95ad-4a08-a9db-0291e2914e74 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:36.044067 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0fe0effc-95ad-4a08-a9db-0291e2914e74 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:36.176975 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4a63b5ac-3e8a-4eef-acb2-abc2932ba889 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:36.185345 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4a63b5ac-3e8a-4eef-acb2-abc2932ba889 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1554 microversion: 2.1 time: 0.165029 Jul 20 08:27:36.185929 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 146/296] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:36 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:36.189748 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-0fe0effc-95ad-4a08-a9db-0291e2914e74 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:36.197511 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0fe0effc-95ad-4a08-a9db-0291e2914e74 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.166041 Jul 20 08:27:36.198080 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 151/297] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:36 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:36.663870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-22980dbc-a851-4ac3-ad78-37409833cd44 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:36.664468 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-22980dbc-a851-4ac3-ad78-37409833cd44 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:36.672085 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-22980dbc-a851-4ac3-ad78-37409833cd44 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:36.672539 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-22980dbc-a851-4ac3-ad78-37409833cd44 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:36.673308 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-22980dbc-a851-4ac3-ad78-37409833cd44 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:36.673739 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-22980dbc-a851-4ac3-ad78-37409833cd44 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:36.742373 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-22980dbc-a851-4ac3-ad78-37409833cd44 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:36.750202 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-22980dbc-a851-4ac3-ad78-37409833cd44 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1274 microversion: 2.1 time: 0.090002 Jul 20 08:27:36.750804 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 147/298] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:36 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1274 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:37.202660 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1d374409-a693-465f-aa13-b6a372dcfda6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:37.203473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1d374409-a693-465f-aa13-b6a372dcfda6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:37.205642 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:27:37.211734 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1d374409-a693-465f-aa13-b6a372dcfda6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:37.212178 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1d374409-a693-465f-aa13-b6a372dcfda6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:37.212978 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1d374409-a693-465f-aa13-b6a372dcfda6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:37.213530 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1d374409-a693-465f-aa13-b6a372dcfda6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:37.215702 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-12959f2f-9335-4873-b4f2-35c547c7a79e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:37.216487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-12959f2f-9335-4873-b4f2-35c547c7a79e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:37.223524 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-12959f2f-9335-4873-b4f2-35c547c7a79e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:37.223971 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-12959f2f-9335-4873-b4f2-35c547c7a79e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:37.224759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-12959f2f-9335-4873-b4f2-35c547c7a79e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:37.225191 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-12959f2f-9335-4873-b4f2-35c547c7a79e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:37.370451 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1d374409-a693-465f-aa13-b6a372dcfda6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:37.373762 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-12959f2f-9335-4873-b4f2-35c547c7a79e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:37.379542 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1d374409-a693-465f-aa13-b6a372dcfda6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1554 microversion: 2.1 time: 0.180940 Jul 20 08:27:37.380226 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 152/299] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:37 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:37.382673 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-12959f2f-9335-4873-b4f2-35c547c7a79e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.171396 Jul 20 08:27:37.383250 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 148/300] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:37 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:37.769117 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7035b0a7-ad74-4c92-b524-2d38fb08279f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:37.769711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-7035b0a7-ad74-4c92-b524-2d38fb08279f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:37.776156 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7035b0a7-ad74-4c92-b524-2d38fb08279f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:37.776599 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7035b0a7-ad74-4c92-b524-2d38fb08279f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:37.777399 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7035b0a7-ad74-4c92-b524-2d38fb08279f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:37.777830 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7035b0a7-ad74-4c92-b524-2d38fb08279f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:37.841683 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-7035b0a7-ad74-4c92-b524-2d38fb08279f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:37.850221 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-7035b0a7-ad74-4c92-b524-2d38fb08279f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1274 microversion: 2.1 time: 0.085688 Jul 20 08:27:37.850831 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 153/301] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:37 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:38.404613 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-b64c57e6-9506-443f-a7ad-e2ccb5ee1a6e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:38.405545 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-bf1069ac-c10a-47b1-b523-700a21ccc601 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:38.405944 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-b64c57e6-9506-443f-a7ad-e2ccb5ee1a6e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:38.406043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-bf1069ac-c10a-47b1-b523-700a21ccc601 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:38.412299 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b64c57e6-9506-443f-a7ad-e2ccb5ee1a6e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:38.412740 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b64c57e6-9506-443f-a7ad-e2ccb5ee1a6e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:38.413514 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b64c57e6-9506-443f-a7ad-e2ccb5ee1a6e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:38.414119 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b64c57e6-9506-443f-a7ad-e2ccb5ee1a6e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:38.417888 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bf1069ac-c10a-47b1-b523-700a21ccc601 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:38.418519 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bf1069ac-c10a-47b1-b523-700a21ccc601 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:38.419512 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bf1069ac-c10a-47b1-b523-700a21ccc601 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:38.420104 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bf1069ac-c10a-47b1-b523-700a21ccc601 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:38.604464 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-bf1069ac-c10a-47b1-b523-700a21ccc601 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:38.616888 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-bf1069ac-c10a-47b1-b523-700a21ccc601 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1554 microversion: 2.1 time: 0.215943 Jul 20 08:27:38.617592 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 154/302] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:38 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1554 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:38.651334 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b64c57e6-9506-443f-a7ad-e2ccb5ee1a6e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:38.662001 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-b64c57e6-9506-443f-a7ad-e2ccb5ee1a6e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.263813 Jul 20 08:27:38.663492 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 149/303] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:38 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:38.875405 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-24a2c53b-27b0-47c0-9cb6-28211a0f7d39 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:38.877303 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-24a2c53b-27b0-47c0-9cb6-28211a0f7d39 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:38.889890 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-24a2c53b-27b0-47c0-9cb6-28211a0f7d39 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:38.891555 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-24a2c53b-27b0-47c0-9cb6-28211a0f7d39 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:38.893236 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-24a2c53b-27b0-47c0-9cb6-28211a0f7d39 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:38.894130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-24a2c53b-27b0-47c0-9cb6-28211a0f7d39 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:39.024729 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-24a2c53b-27b0-47c0-9cb6-28211a0f7d39 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:39.042381 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-24a2c53b-27b0-47c0-9cb6-28211a0f7d39 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1272 microversion: 2.1 time: 0.177967 Jul 20 08:27:39.043256 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 155/304] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:38 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1272 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:39.635638 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6c8e7210-e4b1-4a88-be69-fac7061c611c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:39.636366 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6c8e7210-e4b1-4a88-be69-fac7061c611c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:39.645034 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=64 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:27:39.648494 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6c8e7210-e4b1-4a88-be69-fac7061c611c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:39.649482 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6c8e7210-e4b1-4a88-be69-fac7061c611c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:39.650899 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6c8e7210-e4b1-4a88-be69-fac7061c611c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:39.651535 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6c8e7210-e4b1-4a88-be69-fac7061c611c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:39.695239 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c6fd6025-9bf3-4aff-b109-96401154d4a4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:39.696362 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c6fd6025-9bf3-4aff-b109-96401154d4a4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:39.705724 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c6fd6025-9bf3-4aff-b109-96401154d4a4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:39.706469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c6fd6025-9bf3-4aff-b109-96401154d4a4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:39.707727 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c6fd6025-9bf3-4aff-b109-96401154d4a4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:39.708940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c6fd6025-9bf3-4aff-b109-96401154d4a4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:39.911676 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c6fd6025-9bf3-4aff-b109-96401154d4a4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:39.922801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c6fd6025-9bf3-4aff-b109-96401154d4a4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.236211 Jul 20 08:27:39.923584 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 156/305] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:39 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:40.063785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ac394c0e-1f72-4d7b-9ef9-b67b90e8bb23 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:40.064569 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ac394c0e-1f72-4d7b-9ef9-b67b90e8bb23 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:40.071309 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ac394c0e-1f72-4d7b-9ef9-b67b90e8bb23 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:40.071905 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ac394c0e-1f72-4d7b-9ef9-b67b90e8bb23 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:40.072800 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ac394c0e-1f72-4d7b-9ef9-b67b90e8bb23 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:40.073358 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ac394c0e-1f72-4d7b-9ef9-b67b90e8bb23 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:40.180559 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6c8e7210-e4b1-4a88-be69-fac7061c611c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:40.198358 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6c8e7210-e4b1-4a88-be69-fac7061c611c tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1554 microversion: 2.1 time: 0.567106 Jul 20 08:27:40.199719 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 150/306] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:39 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1554 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:40.251871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ac394c0e-1f72-4d7b-9ef9-b67b90e8bb23 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:40.263047 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ac394c0e-1f72-4d7b-9ef9-b67b90e8bb23 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1314 microversion: 2.1 time: 0.202296 Jul 20 08:27:40.264274 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 157/307] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:40 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:40.596473 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-067023e0-34bc-4ae2-80e8-a0c6063b6bde req-4af7bbe7-93b4-4d20-8330-be1508cde47f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8273f04-3311-466c-b48f-149757006ab9", "tag": "eb6642d2-1021-40f3-a3d6-2143e5810bff"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:27:40.605406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-067023e0-34bc-4ae2-80e8-a0c6063b6bde req-4af7bbe7-93b4-4d20-8330-be1508cde47f service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:40.605406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-067023e0-34bc-4ae2-80e8-a0c6063b6bde req-4af7bbe7-93b4-4d20-8330-be1508cde47f service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:40.620397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-067023e0-34bc-4ae2-80e8-a0c6063b6bde req-4af7bbe7-93b4-4d20-8330-be1508cde47f service nova] Creating event network-changed:eb6642d2-1021-40f3-a3d6-2143e5810bff for instance d8273f04-3311-466c-b48f-149757006ab9 on hv-cinder-82308 Jul 20 08:27:40.626825 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-067023e0-34bc-4ae2-80e8-a0c6063b6bde req-4af7bbe7-93b4-4d20-8330-be1508cde47f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034307 Jul 20 08:27:40.627743 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 151/308] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:27:40.940296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-28b1a298-f76c-40d8-a063-992680d6b648 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:40.940920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-28b1a298-f76c-40d8-a063-992680d6b648 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:40.947364 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-28b1a298-f76c-40d8-a063-992680d6b648 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:40.947844 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-28b1a298-f76c-40d8-a063-992680d6b648 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:40.948630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-28b1a298-f76c-40d8-a063-992680d6b648 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:40.949496 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-28b1a298-f76c-40d8-a063-992680d6b648 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:41.094034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-28b1a298-f76c-40d8-a063-992680d6b648 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:41.102106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-28b1a298-f76c-40d8-a063-992680d6b648 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.165721 Jul 20 08:27:41.102882 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 158/309] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:40 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:41.217660 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-27022bfa-2bf8-403f-ba5f-ba3de4f0377d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:41.218302 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-27022bfa-2bf8-403f-ba5f-ba3de4f0377d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:41.225025 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-27022bfa-2bf8-403f-ba5f-ba3de4f0377d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:41.225466 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-27022bfa-2bf8-403f-ba5f-ba3de4f0377d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:41.226280 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-27022bfa-2bf8-403f-ba5f-ba3de4f0377d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:41.226759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-27022bfa-2bf8-403f-ba5f-ba3de4f0377d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:41.291596 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b83bbf71-bf80-488b-a96d-2f8797212f94 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:41.292689 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b83bbf71-bf80-488b-a96d-2f8797212f94 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:41.301176 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b83bbf71-bf80-488b-a96d-2f8797212f94 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:41.301696 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b83bbf71-bf80-488b-a96d-2f8797212f94 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:41.302746 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b83bbf71-bf80-488b-a96d-2f8797212f94 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:41.303249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b83bbf71-bf80-488b-a96d-2f8797212f94 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:41.414147 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-27022bfa-2bf8-403f-ba5f-ba3de4f0377d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:41.424268 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-27022bfa-2bf8-403f-ba5f-ba3de4f0377d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1554 microversion: 2.1 time: 0.211379 Jul 20 08:27:41.424946 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 152/310] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:41 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1554 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:41.495342 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b83bbf71-bf80-488b-a96d-2f8797212f94 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:41.506283 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b83bbf71-bf80-488b-a96d-2f8797212f94 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1314 microversion: 2.1 time: 0.218971 Jul 20 08:27:41.507070 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 159/311] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:41 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:42.120218 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-7febf02b-218d-49e7-a3fb-bb657424b46e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:42.120818 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-7febf02b-218d-49e7-a3fb-bb657424b46e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:42.129641 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7febf02b-218d-49e7-a3fb-bb657424b46e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:42.130086 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7febf02b-218d-49e7-a3fb-bb657424b46e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:42.130910 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7febf02b-218d-49e7-a3fb-bb657424b46e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:42.131357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7febf02b-218d-49e7-a3fb-bb657424b46e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:42.288136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-7febf02b-218d-49e7-a3fb-bb657424b46e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:42.303523 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-7febf02b-218d-49e7-a3fb-bb657424b46e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.186726 Jul 20 08:27:42.304557 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 153/312] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:42 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:42.441652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-91516170-a38a-4c66-a2be-ec684705dbde tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:42.442514 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-91516170-a38a-4c66-a2be-ec684705dbde tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:42.449297 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-91516170-a38a-4c66-a2be-ec684705dbde tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:42.449746 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-91516170-a38a-4c66-a2be-ec684705dbde tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:42.450649 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-91516170-a38a-4c66-a2be-ec684705dbde tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:42.451098 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-91516170-a38a-4c66-a2be-ec684705dbde tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:42.525538 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d4228aa8-2964-4267-913d-fa176c48face tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:42.526217 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d4228aa8-2964-4267-913d-fa176c48face tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:42.538639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d4228aa8-2964-4267-913d-fa176c48face tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:42.539469 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d4228aa8-2964-4267-913d-fa176c48face tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:42.540485 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d4228aa8-2964-4267-913d-fa176c48face tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:42.541310 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d4228aa8-2964-4267-913d-fa176c48face tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:42.644888 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-91516170-a38a-4c66-a2be-ec684705dbde tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:42.656273 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-91516170-a38a-4c66-a2be-ec684705dbde tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1554 microversion: 2.1 time: 0.218418 Jul 20 08:27:42.667075 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 160/313] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:42 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1554 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:43.136290 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d4228aa8-2964-4267-913d-fa176c48face tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:43.147911 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d4228aa8-2964-4267-913d-fa176c48face tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1314 microversion: 2.1 time: 0.625475 Jul 20 08:27:43.159347 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 154/314] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:42 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:43.330226 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f28cf741-625a-452a-a47c-8c18cfa4cd07 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:43.330867 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f28cf741-625a-452a-a47c-8c18cfa4cd07 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:43.339621 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f28cf741-625a-452a-a47c-8c18cfa4cd07 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:43.340318 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f28cf741-625a-452a-a47c-8c18cfa4cd07 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:43.341676 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f28cf741-625a-452a-a47c-8c18cfa4cd07 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:43.342448 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f28cf741-625a-452a-a47c-8c18cfa4cd07 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:43.580993 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f28cf741-625a-452a-a47c-8c18cfa4cd07 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:43.591429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f28cf741-625a-452a-a47c-8c18cfa4cd07 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.265589 Jul 20 08:27:43.599314 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 161/315] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:43 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:43.618717 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-f8cc52f7-5482-4596-bc2c-f09a78f9c381 req-e6cdea1c-7b92-4c61-97b1-75d79d5f96a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0df430-d3f8-4e9d-949f-5d8f0359484d", "name": "network-vif-deleted", "tag": "1a663922-bde3-4ffe-a3dd-70862157632c"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:27:43.630451 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-f8cc52f7-5482-4596-bc2c-f09a78f9c381 req-e6cdea1c-7b92-4c61-97b1-75d79d5f96a3 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:43.630992 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-f8cc52f7-5482-4596-bc2c-f09a78f9c381 req-e6cdea1c-7b92-4c61-97b1-75d79d5f96a3 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:43.645578 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-f8cc52f7-5482-4596-bc2c-f09a78f9c381 req-e6cdea1c-7b92-4c61-97b1-75d79d5f96a3 service nova] Creating event network-vif-deleted:1a663922-bde3-4ffe-a3dd-70862157632c for instance fa0df430-d3f8-4e9d-949f-5d8f0359484d on hv-cinder-82308 Jul 20 08:27:43.651688 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-f8cc52f7-5482-4596-bc2c-f09a78f9c381 req-e6cdea1c-7b92-4c61-97b1-75d79d5f96a3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036995 Jul 20 08:27:43.652456 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 155/316] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:27:43.675988 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-cdfe4afe-ca6f-4da7-a2e4-b2b232054a40 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:43.676733 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-cdfe4afe-ca6f-4da7-a2e4-b2b232054a40 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:43.689849 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-cdfe4afe-ca6f-4da7-a2e4-b2b232054a40 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:43.690298 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-cdfe4afe-ca6f-4da7-a2e4-b2b232054a40 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:43.691443 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-cdfe4afe-ca6f-4da7-a2e4-b2b232054a40 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:43.691872 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-cdfe4afe-ca6f-4da7-a2e4-b2b232054a40 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:43.765026 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-cdfe4afe-ca6f-4da7-a2e4-b2b232054a40 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:43.775522 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-cdfe4afe-ca6f-4da7-a2e4-b2b232054a40 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1512 microversion: 2.1 time: 0.104456 Jul 20 08:27:43.776115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 162/317] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:43 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1512 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:44.167500 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f455a8ad-125a-4f40-824a-0349e926613e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:44.168515 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f455a8ad-125a-4f40-824a-0349e926613e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:44.175619 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f455a8ad-125a-4f40-824a-0349e926613e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:44.176418 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f455a8ad-125a-4f40-824a-0349e926613e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:44.177410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f455a8ad-125a-4f40-824a-0349e926613e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:44.177832 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f455a8ad-125a-4f40-824a-0349e926613e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:44.429888 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f455a8ad-125a-4f40-824a-0349e926613e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:44.438770 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f455a8ad-125a-4f40-824a-0349e926613e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1314 microversion: 2.1 time: 0.275469 Jul 20 08:27:44.439353 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 156/318] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:44 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:44.611268 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7e96671a-669a-45f4-85ed-a90376fabdf1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:44.612544 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-7e96671a-669a-45f4-85ed-a90376fabdf1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:44.618863 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=2 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:27:44.619574 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=6 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:27:44.621381 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7e96671a-669a-45f4-85ed-a90376fabdf1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:44.622300 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7e96671a-669a-45f4-85ed-a90376fabdf1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:44.623462 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7e96671a-669a-45f4-85ed-a90376fabdf1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:44.624128 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7e96671a-669a-45f4-85ed-a90376fabdf1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:44.800422 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-53000751-05a9-4c9d-b983-bdaf6fa522c1 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:44.803971 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-53000751-05a9-4c9d-b983-bdaf6fa522c1 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:44.818355 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=2 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:27:44.823627 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-53000751-05a9-4c9d-b983-bdaf6fa522c1 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:44.825121 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-53000751-05a9-4c9d-b983-bdaf6fa522c1 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:44.826834 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-53000751-05a9-4c9d-b983-bdaf6fa522c1 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:44.828057 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-53000751-05a9-4c9d-b983-bdaf6fa522c1 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:44.847404 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-7e96671a-669a-45f4-85ed-a90376fabdf1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:44.860778 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-7e96671a-669a-45f4-85ed-a90376fabdf1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1523 microversion: 2.1 time: 0.253975 Jul 20 08:27:44.862817 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 163/319] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:44 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:44.958479 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-53000751-05a9-4c9d-b983-bdaf6fa522c1 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:44.960809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:27:44.969116 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-53000751-05a9-4c9d-b983-bdaf6fa522c1 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1345 microversion: 2.1 time: 0.177066 Jul 20 08:27:44.969760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 157/320] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:44 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1345 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:45.459507 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-cfa3f1d5-3b93-49d2-a8ac-a97bef69b2ef tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:45.461404 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-cfa3f1d5-3b93-49d2-a8ac-a97bef69b2ef tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:45.474244 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-cfa3f1d5-3b93-49d2-a8ac-a97bef69b2ef tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:45.475751 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-cfa3f1d5-3b93-49d2-a8ac-a97bef69b2ef tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:45.478625 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-cfa3f1d5-3b93-49d2-a8ac-a97bef69b2ef tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:45.479685 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-cfa3f1d5-3b93-49d2-a8ac-a97bef69b2ef tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:45.503887 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:27:45.652393 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-cfa3f1d5-3b93-49d2-a8ac-a97bef69b2ef tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:45.667645 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-cfa3f1d5-3b93-49d2-a8ac-a97bef69b2ef tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1314 microversion: 2.1 time: 0.213403 Jul 20 08:27:45.668217 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 164/321] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:45 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:45.890133 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d3dc50b2-b812-4991-bbea-d15ebb0a7787 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:45.891626 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d3dc50b2-b812-4991-bbea-d15ebb0a7787 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:45.900887 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d3dc50b2-b812-4991-bbea-d15ebb0a7787 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:45.901648 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d3dc50b2-b812-4991-bbea-d15ebb0a7787 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:45.902965 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d3dc50b2-b812-4991-bbea-d15ebb0a7787 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:45.903529 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d3dc50b2-b812-4991-bbea-d15ebb0a7787 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:45.986814 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-294d3966-6efc-4d52-862d-133acfafab9b tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:45.987501 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-294d3966-6efc-4d52-862d-133acfafab9b tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:45.999449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-294d3966-6efc-4d52-862d-133acfafab9b tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:46.000790 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-294d3966-6efc-4d52-862d-133acfafab9b tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:46.001834 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-294d3966-6efc-4d52-862d-133acfafab9b tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:46.002425 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-294d3966-6efc-4d52-862d-133acfafab9b tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:46.035878 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-294d3966-6efc-4d52-862d-133acfafab9b tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:46.036329 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-294d3966-6efc-4d52-862d-133acfafab9b tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:46.036933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.objects.instance [None req-294d3966-6efc-4d52-862d-133acfafab9b tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lazy-loading 'fault' on Instance uuid fa0df430-d3f8-4e9d-949f-5d8f0359484d {{(pid=117828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:27:46.060631 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d3dc50b2-b812-4991-bbea-d15ebb0a7787 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:46.069690 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d3dc50b2-b812-4991-bbea-d15ebb0a7787 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1503 microversion: 2.1 time: 0.184117 Jul 20 08:27:46.070021 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 158/322] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:45 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:46.093375 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-294d3966-6efc-4d52-862d-133acfafab9b tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:46.096934 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-57cce566-5969-4efd-b215-82319d0ec5fe tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:46.097649 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-57cce566-5969-4efd-b215-82319d0ec5fe tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:46.105949 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-57cce566-5969-4efd-b215-82319d0ec5fe tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:46.106629 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-57cce566-5969-4efd-b215-82319d0ec5fe tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:46.108563 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-57cce566-5969-4efd-b215-82319d0ec5fe tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:46.109788 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-57cce566-5969-4efd-b215-82319d0ec5fe tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:46.112982 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-294d3966-6efc-4d52-862d-133acfafab9b tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1350 microversion: 2.1 time: 0.130711 Jul 20 08:27:46.114535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 165/323] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:45 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:46.263555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-57cce566-5969-4efd-b215-82319d0ec5fe tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:46.273454 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-57cce566-5969-4efd-b215-82319d0ec5fe tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1516 microversion: 2.1 time: 0.181486 Jul 20 08:27:46.273965 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 159/324] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:46 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:46.685673 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-6afd0f99-fc8d-4ccb-bd4e-afa60f465704 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:46.686424 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-6afd0f99-fc8d-4ccb-bd4e-afa60f465704 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:46.694250 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6afd0f99-fc8d-4ccb-bd4e-afa60f465704 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:46.694732 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6afd0f99-fc8d-4ccb-bd4e-afa60f465704 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:46.695494 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6afd0f99-fc8d-4ccb-bd4e-afa60f465704 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:46.695923 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6afd0f99-fc8d-4ccb-bd4e-afa60f465704 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:46.856011 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-6afd0f99-fc8d-4ccb-bd4e-afa60f465704 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:46.865488 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-6afd0f99-fc8d-4ccb-bd4e-afa60f465704 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1314 microversion: 2.1 time: 0.183567 Jul 20 08:27:46.866199 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 166/325] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:46 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:47.131742 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-2237bb30-fc04-4fed-aaea-e548b0beffdf tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:47.132360 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-2237bb30-fc04-4fed-aaea-e548b0beffdf tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:47.139578 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2237bb30-fc04-4fed-aaea-e548b0beffdf tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:47.140033 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2237bb30-fc04-4fed-aaea-e548b0beffdf tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:47.140807 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2237bb30-fc04-4fed-aaea-e548b0beffdf tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:47.144239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2237bb30-fc04-4fed-aaea-e548b0beffdf tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:47.179937 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2237bb30-fc04-4fed-aaea-e548b0beffdf tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:47.180382 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2237bb30-fc04-4fed-aaea-e548b0beffdf tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:47.180852 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.objects.instance [None req-2237bb30-fc04-4fed-aaea-e548b0beffdf tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lazy-loading 'fault' on Instance uuid fa0df430-d3f8-4e9d-949f-5d8f0359484d {{(pid=117829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:27:47.226185 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-2237bb30-fc04-4fed-aaea-e548b0beffdf tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:47.235966 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-2237bb30-fc04-4fed-aaea-e548b0beffdf tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1350 microversion: 2.1 time: 0.107597 Jul 20 08:27:47.236459 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 160/326] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:47 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1350 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:47.884271 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-14319383-a699-4519-ad64-95da25e8d0fb tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:47.884877 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-14319383-a699-4519-ad64-95da25e8d0fb tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:47.895503 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-14319383-a699-4519-ad64-95da25e8d0fb tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:47.896189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-14319383-a699-4519-ad64-95da25e8d0fb tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:47.897324 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-14319383-a699-4519-ad64-95da25e8d0fb tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:47.897915 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-14319383-a699-4519-ad64-95da25e8d0fb tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:48.250277 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-14319383-a699-4519-ad64-95da25e8d0fb tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:48.253938 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-0b67066c-1e20-4af3-96ea-5429a7c6c545 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:48.255109 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-0b67066c-1e20-4af3-96ea-5429a7c6c545 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:48.258241 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-14319383-a699-4519-ad64-95da25e8d0fb tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1314 microversion: 2.1 time: 0.377913 Jul 20 08:27:48.258835 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 167/327] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:47 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:48.261864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0b67066c-1e20-4af3-96ea-5429a7c6c545 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:48.262427 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0b67066c-1e20-4af3-96ea-5429a7c6c545 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:48.263220 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0b67066c-1e20-4af3-96ea-5429a7c6c545 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:48.263650 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0b67066c-1e20-4af3-96ea-5429a7c6c545 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:48.294967 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0b67066c-1e20-4af3-96ea-5429a7c6c545 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:48.295410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0b67066c-1e20-4af3-96ea-5429a7c6c545 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:48.295845 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.objects.instance [None req-0b67066c-1e20-4af3-96ea-5429a7c6c545 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lazy-loading 'fault' on Instance uuid fa0df430-d3f8-4e9d-949f-5d8f0359484d {{(pid=117829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:27:48.340193 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0b67066c-1e20-4af3-96ea-5429a7c6c545 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:48.348020 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-0b67066c-1e20-4af3-96ea-5429a7c6c545 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1350 microversion: 2.1 time: 0.099092 Jul 20 08:27:48.348587 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 161/328] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:48 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:48.726426 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c9aa760d-1ee4-4a12-8145-118bb3a39438 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:27:48.727631 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c9aa760d-1ee4-4a12-8145-118bb3a39438 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:48.734887 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c9aa760d-1ee4-4a12-8145-118bb3a39438 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:48.735334 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c9aa760d-1ee4-4a12-8145-118bb3a39438 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:48.736120 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c9aa760d-1ee4-4a12-8145-118bb3a39438 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:48.736548 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c9aa760d-1ee4-4a12-8145-118bb3a39438 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:48.761980 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.objects.instance [None req-c9aa760d-1ee4-4a12-8145-118bb3a39438 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lazy-loading 'flavor' on Instance uuid ff2ea553-bf93-4f6e-b624-935ecec595b7 {{(pid=117828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:27:48.842260 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c9aa760d-1ee4-4a12-8145-118bb3a39438 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "POST /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7/action" status: 200 len: 32 microversion: 2.1 time: 0.119824 Jul 20 08:27:48.842897 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 168/329] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Jul 20 08:27:48 2022] POST /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7/action => generated 32 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 08:27:48.852987 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-b7c76df0-8817-4952-abbc-19b814e5b61a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:48.853600 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-b7c76df0-8817-4952-abbc-19b814e5b61a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:48.859710 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b7c76df0-8817-4952-abbc-19b814e5b61a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:48.860161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b7c76df0-8817-4952-abbc-19b814e5b61a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:48.860936 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b7c76df0-8817-4952-abbc-19b814e5b61a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:48.861372 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b7c76df0-8817-4952-abbc-19b814e5b61a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:49.021247 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b7c76df0-8817-4952-abbc-19b814e5b61a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:49.031540 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-b7c76df0-8817-4952-abbc-19b814e5b61a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.182667 Jul 20 08:27:49.032692 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 162/330] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:48 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:49.276509 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-72af93a2-1901-4d5e-98ef-e2a395302d07 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:49.277201 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-72af93a2-1901-4d5e-98ef-e2a395302d07 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:49.284124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-72af93a2-1901-4d5e-98ef-e2a395302d07 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:49.284571 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-72af93a2-1901-4d5e-98ef-e2a395302d07 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:49.285340 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-72af93a2-1901-4d5e-98ef-e2a395302d07 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:49.285773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-72af93a2-1901-4d5e-98ef-e2a395302d07 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:49.365957 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-1eb3faf9-35a2-4147-a05e-e2ceb42a4e65 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:49.366571 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-1eb3faf9-35a2-4147-a05e-e2ceb42a4e65 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:49.373878 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1eb3faf9-35a2-4147-a05e-e2ceb42a4e65 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:49.374324 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1eb3faf9-35a2-4147-a05e-e2ceb42a4e65 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:49.375216 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1eb3faf9-35a2-4147-a05e-e2ceb42a4e65 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:49.375694 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1eb3faf9-35a2-4147-a05e-e2ceb42a4e65 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:49.410216 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1eb3faf9-35a2-4147-a05e-e2ceb42a4e65 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:49.410670 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1eb3faf9-35a2-4147-a05e-e2ceb42a4e65 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:49.411115 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.objects.instance [None req-1eb3faf9-35a2-4147-a05e-e2ceb42a4e65 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lazy-loading 'fault' on Instance uuid fa0df430-d3f8-4e9d-949f-5d8f0359484d {{(pid=117829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:27:49.455620 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1eb3faf9-35a2-4147-a05e-e2ceb42a4e65 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf1a059ddb34c2d8181712f53d592c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b481fa73344413d85fc2eb5c0376c9d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:49.465965 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-1eb3faf9-35a2-4147-a05e-e2ceb42a4e65 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 200 len: 1350 microversion: 2.1 time: 0.103839 Jul 20 08:27:49.466660 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 163/331] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:49 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 1350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:49.571755 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-72af93a2-1901-4d5e-98ef-e2a395302d07 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:49.580504 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-72af93a2-1901-4d5e-98ef-e2a395302d07 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1314 microversion: 2.1 time: 0.308120 Jul 20 08:27:49.581203 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 169/332] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:49 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:50.050456 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-04ed6988-6e69-4457-9f3d-6af0ab18ac93 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:50.051084 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-04ed6988-6e69-4457-9f3d-6af0ab18ac93 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:50.057202 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-04ed6988-6e69-4457-9f3d-6af0ab18ac93 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:50.057656 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-04ed6988-6e69-4457-9f3d-6af0ab18ac93 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:50.058428 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-04ed6988-6e69-4457-9f3d-6af0ab18ac93 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:50.059056 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-04ed6988-6e69-4457-9f3d-6af0ab18ac93 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:50.222384 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-04ed6988-6e69-4457-9f3d-6af0ab18ac93 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:50.238288 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-04ed6988-6e69-4457-9f3d-6af0ab18ac93 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.191741 Jul 20 08:27:50.239134 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 164/333] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:50 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:50.486889 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3ab01b30-f535-47db-b293-cfc0e1af7ad5 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:50.487687 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-3ab01b30-f535-47db-b293-cfc0e1af7ad5 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:50.495500 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ab01b30-f535-47db-b293-cfc0e1af7ad5 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:50.496361 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ab01b30-f535-47db-b293-cfc0e1af7ad5 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:50.497608 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ab01b30-f535-47db-b293-cfc0e1af7ad5 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:50.498490 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ab01b30-f535-47db-b293-cfc0e1af7ad5 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:50.519697 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-3ab01b30-f535-47db-b293-cfc0e1af7ad5 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] HTTP exception thrown: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3ab01b30-f535-47db-b293-cfc0e1af7ad5 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Request method failure captured: Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d HTTP/1.1 Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wn22bvP2WqRhn3e2glAYVQG78fiDM7epIfmv2Km6SwHG9NSfJUqPo4fUjnixlflmS-TvPlIa6oXrAOibPKoEvbWrLRX5MEbmrsZsiMCkhpNPCt_t84sG7qyRDWEpuxerOz8LOsnplOBWrhgmJBNlRQU6q4PRCY4ERD59XHOFRuIvw Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: 1b481fa73344413d85fc2eb5c0376c9d Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-DeleteServersTestJSON-1860605861 Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:27:50.537171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:27:50.538920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b481fa73344413d85fc2eb5c0376c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1b481fa73344413d85fc2eb5c0376c9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1b481fa73344413d85fc2eb5c0376c9d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b481fa73344413d85fc2eb5c0376c9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:27:50.538920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-DeleteServersTestJSON-1860605861 Jul 20 08:27:50.538920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: 1b481fa73344413d85fc2eb5c0376c9d Jul 20 08:27:50.538920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860605861 Jul 20 08:27:50.538920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-DeleteServersTestJSON-1860605861-project Jul 20 08:27:50.538920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:27:50.538920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:27:50.538920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: 5bf1a059ddb34c2d8181712f53d592c2 Jul 20 08:27:50.538920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-DeleteServersTestJSON-1860605861-project Jul 20 08:27:50.538920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:27:50.538920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. Jul 20 08:27:50.538920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': 'fa0df430-d3f8-4e9d-949f-5d8f0359484d'} Jul 20 08:27:50.539706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:27:50.539706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:27:50.539706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:27:50.539706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:27:50.539706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:27:50.539706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:27:50.539706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:27:50.539706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:27:50.539706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:27:50.539706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:27:50.539706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. Jul 20 08:27:50.539706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:27:50.539706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:27:50.539706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:27:50.539706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:27:50.539706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:27:50.539706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:27:50.539706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:27:50.539706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:27:50.539706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:27:50.541054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:27:50.541054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:27:50.541054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:27:50.541054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:27:50.541054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:27:50.541054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:27:50.541054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:27:50.541054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. Jul 20 08:27:50.541054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:27:50.541054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:27:50.541054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:27:50.541054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:27:50.541054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:27:50.541054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:27:50.541054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:27:50.541054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:27:50.541054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. Jul 20 08:27:50.541054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:27:50.542245 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3ab01b30-f535-47db-b293-cfc0e1af7ad5 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Returning 404 to user: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:27:50.542245 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-3ab01b30-f535-47db-b293-cfc0e1af7ad5 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 404 len: 111 microversion: 2.1 time: 0.059911 Jul 20 08:27:50.543101 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 170/334] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:50 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:27:50.602986 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9c5222bd-18e6-466c-b77f-765cd546f00d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:50.608532 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9c5222bd-18e6-466c-b77f-765cd546f00d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:50.627003 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9c5222bd-18e6-466c-b77f-765cd546f00d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:50.630799 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9c5222bd-18e6-466c-b77f-765cd546f00d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:50.631828 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9c5222bd-18e6-466c-b77f-765cd546f00d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:50.633439 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9c5222bd-18e6-466c-b77f-765cd546f00d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:50.676067 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-83b49eec-0410-437f-9bc8-96a5370b9b2d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:50.677331 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-83b49eec-0410-437f-9bc8-96a5370b9b2d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:50.683737 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-83b49eec-0410-437f-9bc8-96a5370b9b2d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:50.684407 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-83b49eec-0410-437f-9bc8-96a5370b9b2d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:50.685313 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-83b49eec-0410-437f-9bc8-96a5370b9b2d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:50.685886 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-83b49eec-0410-437f-9bc8-96a5370b9b2d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:50.701689 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-83b49eec-0410-437f-9bc8-96a5370b9b2d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] HTTP exception thrown: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-83b49eec-0410-437f-9bc8-96a5370b9b2d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Request method failure captured: Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d/os-volume_attachments HTTP/1.1 Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wn22bvP2WqRhn3e2glAYVQG78fiDM7epIfmv2Km6SwHG9NSfJUqPo4fUjnixlflmS-TvPlIa6oXrAOibPKoEvbWrLRX5MEbmrsZsiMCkhpNPCt_t84sG7qyRDWEpuxerOz8LOsnplOBWrhgmJBNlRQU6q4PRCY4ERD59XHOFRuIvw Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: 1b481fa73344413d85fc2eb5c0376c9d Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-DeleteServersTestJSON-1860605861 Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:27:50.703513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:27:50.704875 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b481fa73344413d85fc2eb5c0376c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1b481fa73344413d85fc2eb5c0376c9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1b481fa73344413d85fc2eb5c0376c9d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b481fa73344413d85fc2eb5c0376c9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:27:50.704875 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-DeleteServersTestJSON-1860605861 Jul 20 08:27:50.704875 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: 1b481fa73344413d85fc2eb5c0376c9d Jul 20 08:27:50.704875 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860605861 Jul 20 08:27:50.704875 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-DeleteServersTestJSON-1860605861-project Jul 20 08:27:50.704875 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:27:50.704875 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:27:50.704875 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: 5bf1a059ddb34c2d8181712f53d592c2 Jul 20 08:27:50.704875 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-DeleteServersTestJSON-1860605861-project Jul 20 08:27:50.704875 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:27:50.704875 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. Jul 20 08:27:50.704875 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'server_id': 'fa0df430-d3f8-4e9d-949f-5d8f0359484d'} Jul 20 08:27:50.705652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:27:50.705652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:27:50.705652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:27:50.705652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:27:50.705652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:27:50.705652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:27:50.705652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:27:50.705652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:27:50.705652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:27:50.705652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:27:50.705652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. Jul 20 08:27:50.705652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:27:50.705652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:27:50.705652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:27:50.705652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:27:50.705652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:27:50.705652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:27:50.705652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:27:50.705652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:27:50.705652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:27:50.706925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:27:50.706925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 08:27:50.706925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 08:27:50.706925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 08:27:50.706925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 08:27:50.706925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 08:27:50.706925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 08:27:50.706925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:27:50.706925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:27:50.706925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. Jul 20 08:27:50.706925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:27:50.706925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:27:50.706925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:27:50.706925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:27:50.706925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:27:50.706925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:27:50.706925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:27:50.706925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:27:50.706925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. Jul 20 08:27:50.706925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:27:50.709266 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-83b49eec-0410-437f-9bc8-96a5370b9b2d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Returning 404 to user: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:27:50.710887 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-83b49eec-0410-437f-9bc8-96a5370b9b2d tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039331 Jul 20 08:27:50.715246 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 171/335] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Jul 20 08:27:50 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 08:27:50.996645 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9c5222bd-18e6-466c-b77f-765cd546f00d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:51.009864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9c5222bd-18e6-466c-b77f-765cd546f00d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1314 microversion: 2.1 time: 0.413058 Jul 20 08:27:51.015876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 165/336] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:50 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:51.256996 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-89af0ecf-d8c6-439d-a074-cea9fb68c7d4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:51.257525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-89af0ecf-d8c6-439d-a074-cea9fb68c7d4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:51.264719 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-89af0ecf-d8c6-439d-a074-cea9fb68c7d4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:51.265588 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-89af0ecf-d8c6-439d-a074-cea9fb68c7d4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:51.266561 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-89af0ecf-d8c6-439d-a074-cea9fb68c7d4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:51.267203 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-89af0ecf-d8c6-439d-a074-cea9fb68c7d4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:51.490629 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-89af0ecf-d8c6-439d-a074-cea9fb68c7d4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:51.500885 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-89af0ecf-d8c6-439d-a074-cea9fb68c7d4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.247926 Jul 20 08:27:51.502411 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 172/337] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:51 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:51.998764 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-cfcf3307-497d-4e92-8591-e0c9618339a6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:51.999546 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-cfcf3307-497d-4e92-8591-e0c9618339a6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:52.006628 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cfcf3307-497d-4e92-8591-e0c9618339a6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:52.007092 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cfcf3307-497d-4e92-8591-e0c9618339a6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:52.007876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cfcf3307-497d-4e92-8591-e0c9618339a6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:52.008314 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cfcf3307-497d-4e92-8591-e0c9618339a6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:52.023107 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-cfcf3307-497d-4e92-8591-e0c9618339a6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] HTTP exception thrown: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-cfcf3307-497d-4e92-8591-e0c9618339a6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Request method failure captured: Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: DELETE /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d HTTP/1.1 Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17wn22bvP2WqRhn3e2glAYVQG78fiDM7epIfmv2Km6SwHG9NSfJUqPo4fUjnixlflmS-TvPlIa6oXrAOibPKoEvbWrLRX5MEbmrsZsiMCkhpNPCt_t84sG7qyRDWEpuxerOz8LOsnplOBWrhgmJBNlRQU6q4PRCY4ERD59XHOFRuIvw Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: 1b481fa73344413d85fc2eb5c0376c9d Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-DeleteServersTestJSON-1860605861 Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:27:52.027678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:27:52.029161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b481fa73344413d85fc2eb5c0376c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1b481fa73344413d85fc2eb5c0376c9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1b481fa73344413d85fc2eb5c0376c9d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b481fa73344413d85fc2eb5c0376c9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:27:52.029161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-DeleteServersTestJSON-1860605861 Jul 20 08:27:52.029161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: 1b481fa73344413d85fc2eb5c0376c9d Jul 20 08:27:52.029161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860605861 Jul 20 08:27:52.029161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-DeleteServersTestJSON-1860605861-project Jul 20 08:27:52.029161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:27:52.029161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:27:52.029161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: 5bf1a059ddb34c2d8181712f53d592c2 Jul 20 08:27:52.029161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-DeleteServersTestJSON-1860605861-project Jul 20 08:27:52.029161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: > Jul 20 08:27:52.029161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. Jul 20 08:27:52.029161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': 'fa0df430-d3f8-4e9d-949f-5d8f0359484d'} Jul 20 08:27:52.030038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:27:52.030038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:27:52.030038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:27:52.030038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:27:52.030038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:27:52.030038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:27:52.030038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:27:52.030038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:27:52.030038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:27:52.030038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:27:52.030038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. Jul 20 08:27:52.030038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:27:52.030038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:27:52.030038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:27:52.030038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:27:52.030038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:27:52.030038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:27:52.030038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:27:52.030038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:27:52.030038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:27:52.031284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:27:52.031284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 08:27:52.031284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 08:27:52.031284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 08:27:52.031284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 08:27:52.031284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:27:52.031284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:27:52.031284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:27:52.031284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:27:52.031284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. Jul 20 08:27:52.031284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:27:52.031284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:27:52.031284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:27:52.031284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:27:52.031284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:27:52.031284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:27:52.031284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:27:52.031284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:27:52.031284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. Jul 20 08:27:52.031284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:27:52.032593 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-cfcf3307-497d-4e92-8591-e0c9618339a6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Returning 404 to user: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:27:52.032593 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-cfcf3307-497d-4e92-8591-e0c9618339a6 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "DELETE /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 404 len: 111 microversion: 2.1 time: 0.034390 Jul 20 08:27:52.032593 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 166/338] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:27:51 2022] DELETE /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:27:52.036172 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-229f78fa-0116-4bb7-b706-b655914201e5 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:52.037283 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-229f78fa-0116-4bb7-b706-b655914201e5 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:52.037764 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-84c377e6-cbdd-47f5-b146-2547197cdad9 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:52.038370 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-84c377e6-cbdd-47f5-b146-2547197cdad9 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] [instance: fa0df430-d3f8-4e9d-949f-5d8f0359484d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:52.045724 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-84c377e6-cbdd-47f5-b146-2547197cdad9 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:52.046149 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-229f78fa-0116-4bb7-b706-b655914201e5 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:52.046852 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-84c377e6-cbdd-47f5-b146-2547197cdad9 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:52.047858 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-84c377e6-cbdd-47f5-b146-2547197cdad9 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:52.048303 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-84c377e6-cbdd-47f5-b146-2547197cdad9 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:52.048422 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-229f78fa-0116-4bb7-b706-b655914201e5 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:52.049440 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-229f78fa-0116-4bb7-b706-b655914201e5 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:52.050064 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-229f78fa-0116-4bb7-b706-b655914201e5 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:52.065474 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-84c377e6-cbdd-47f5-b146-2547197cdad9 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] HTTP exception thrown: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-84c377e6-cbdd-47f5-b146-2547197cdad9 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Request method failure captured: Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d HTTP/1.1 Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17wn22bvP2WqRhn3e2glAYVQG78fiDM7epIfmv2Km6SwHG9NSfJUqPo4fUjnixlflmS-TvPlIa6oXrAOibPKoEvbWrLRX5MEbmrsZsiMCkhpNPCt_t84sG7qyRDWEpuxerOz8LOsnplOBWrhgmJBNlRQU6q4PRCY4ERD59XHOFRuIvw Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: 1b481fa73344413d85fc2eb5c0376c9d Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-DeleteServersTestJSON-1860605861 Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:27:52.067127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:27:52.068295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b481fa73344413d85fc2eb5c0376c9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1b481fa73344413d85fc2eb5c0376c9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1b481fa73344413d85fc2eb5c0376c9d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b481fa73344413d85fc2eb5c0376c9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:27:52.068295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-DeleteServersTestJSON-1860605861 Jul 20 08:27:52.068295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: 1b481fa73344413d85fc2eb5c0376c9d Jul 20 08:27:52.068295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-DeleteServersTestJSON-1860605861 Jul 20 08:27:52.068295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-DeleteServersTestJSON-1860605861-project Jul 20 08:27:52.068295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:27:52.068295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:27:52.068295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: 5bf1a059ddb34c2d8181712f53d592c2 Jul 20 08:27:52.068295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-DeleteServersTestJSON-1860605861-project Jul 20 08:27:52.068295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: > Jul 20 08:27:52.068295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. Jul 20 08:27:52.068295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': 'fa0df430-d3f8-4e9d-949f-5d8f0359484d'} Jul 20 08:27:52.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:27:52.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:27:52.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:27:52.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:27:52.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:27:52.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:27:52.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:27:52.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:27:52.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:27:52.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:27:52.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. Jul 20 08:27:52.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:27:52.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:27:52.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:27:52.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:27:52.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:27:52.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:27:52.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:27:52.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:27:52.068924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:27:52.069954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:27:52.069954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:27:52.069954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:27:52.069954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:27:52.069954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:27:52.069954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:27:52.069954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:27:52.069954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. Jul 20 08:27:52.069954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:27:52.069954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:27:52.069954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:27:52.069954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:27:52.069954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:27:52.069954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:27:52.069954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:27:52.069954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:27:52.069954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. Jul 20 08:27:52.069954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:27:52.071865 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-84c377e6-cbdd-47f5-b146-2547197cdad9 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] Returning 404 to user: Instance fa0df430-d3f8-4e9d-949f-5d8f0359484d could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:27:52.073866 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-84c377e6-cbdd-47f5-b146-2547197cdad9 tempest-DeleteServersTestJSON-1860605861 tempest-DeleteServersTestJSON-1860605861-project] 10.222.0.64 "GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d" status: 404 len: 111 microversion: 2.1 time: 0.038872 Jul 20 08:27:52.074928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 167/339] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:52 2022] GET /compute/v2.1/servers/fa0df430-d3f8-4e9d-949f-5d8f0359484d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:27:52.381690 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-229f78fa-0116-4bb7-b706-b655914201e5 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:52.391765 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-229f78fa-0116-4bb7-b706-b655914201e5 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1314 microversion: 2.1 time: 0.363107 Jul 20 08:27:52.401559 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 173/340] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:52 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:52.520443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-85d10d06-aa7f-46d2-9612-8fb854322070 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:52.521698 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-85d10d06-aa7f-46d2-9612-8fb854322070 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:52.528816 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-85d10d06-aa7f-46d2-9612-8fb854322070 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:52.529368 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-85d10d06-aa7f-46d2-9612-8fb854322070 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:52.530338 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-85d10d06-aa7f-46d2-9612-8fb854322070 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:52.530855 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-85d10d06-aa7f-46d2-9612-8fb854322070 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:52.831449 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-85d10d06-aa7f-46d2-9612-8fb854322070 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:52.839903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-85d10d06-aa7f-46d2-9612-8fb854322070 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.325227 Jul 20 08:27:52.840614 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 168/341] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:52 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:53.414663 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-b6a51f7b-4b46-4ed1-b403-e39843b66b32 req-8c1af4e2-6091-4537-a9f4-64a74c14eede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8273f04-3311-466c-b48f-149757006ab9", "name": "network-vif-plugged", "status": "completed", "tag": "eb6642d2-1021-40f3-a3d6-2143e5810bff"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:27:53.415891 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d66d644c-e767-4c85-98fc-3bd1e5cda95a tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:53.416505 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d66d644c-e767-4c85-98fc-3bd1e5cda95a tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:53.427373 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-b6a51f7b-4b46-4ed1-b403-e39843b66b32 req-8c1af4e2-6091-4537-a9f4-64a74c14eede service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:53.427946 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-b6a51f7b-4b46-4ed1-b403-e39843b66b32 req-8c1af4e2-6091-4537-a9f4-64a74c14eede service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:53.429140 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d66d644c-e767-4c85-98fc-3bd1e5cda95a tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:53.429586 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d66d644c-e767-4c85-98fc-3bd1e5cda95a tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:53.430370 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d66d644c-e767-4c85-98fc-3bd1e5cda95a tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:53.430826 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d66d644c-e767-4c85-98fc-3bd1e5cda95a tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:53.450274 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-b6a51f7b-4b46-4ed1-b403-e39843b66b32 req-8c1af4e2-6091-4537-a9f4-64a74c14eede service nova] Creating event network-vif-plugged:eb6642d2-1021-40f3-a3d6-2143e5810bff for instance d8273f04-3311-466c-b48f-149757006ab9 on hv-cinder-82308 Jul 20 08:27:53.469340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-b6a51f7b-4b46-4ed1-b403-e39843b66b32 req-8c1af4e2-6091-4537-a9f4-64a74c14eede service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058324 Jul 20 08:27:53.470136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 169/342] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:27:53.699727 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d66d644c-e767-4c85-98fc-3bd1e5cda95a tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:53.709558 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d66d644c-e767-4c85-98fc-3bd1e5cda95a tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1314 microversion: 2.1 time: 0.297323 Jul 20 08:27:53.710555 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 174/343] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:53 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:53.859179 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f0c43c4c-9291-45a7-84a9-e8b50bdd7948 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:53.859782 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f0c43c4c-9291-45a7-84a9-e8b50bdd7948 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:53.865995 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f0c43c4c-9291-45a7-84a9-e8b50bdd7948 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:53.866450 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f0c43c4c-9291-45a7-84a9-e8b50bdd7948 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:53.867320 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f0c43c4c-9291-45a7-84a9-e8b50bdd7948 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:53.867759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f0c43c4c-9291-45a7-84a9-e8b50bdd7948 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:54.010039 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f0c43c4c-9291-45a7-84a9-e8b50bdd7948 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:54.019349 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f0c43c4c-9291-45a7-84a9-e8b50bdd7948 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.164916 Jul 20 08:27:54.020300 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 170/344] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:53 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:54.738457 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-2a0f312b-a173-42c8-9bbf-f3691de56880 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:54.741067 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-2a0f312b-a173-42c8-9bbf-f3691de56880 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:54.748725 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2a0f312b-a173-42c8-9bbf-f3691de56880 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:54.750157 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2a0f312b-a173-42c8-9bbf-f3691de56880 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:54.751964 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2a0f312b-a173-42c8-9bbf-f3691de56880 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:54.752934 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2a0f312b-a173-42c8-9bbf-f3691de56880 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:55.037796 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-de15287d-f6d5-4442-a27d-17da38d6b5a1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:55.038557 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-de15287d-f6d5-4442-a27d-17da38d6b5a1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:55.045390 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-de15287d-f6d5-4442-a27d-17da38d6b5a1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:55.052062 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-de15287d-f6d5-4442-a27d-17da38d6b5a1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:55.052893 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-de15287d-f6d5-4442-a27d-17da38d6b5a1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:55.053488 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-de15287d-f6d5-4442-a27d-17da38d6b5a1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:55.158833 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2a0f312b-a173-42c8-9bbf-f3691de56880 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:55.167158 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-2a0f312b-a173-42c8-9bbf-f3691de56880 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1314 microversion: 2.1 time: 0.440263 Jul 20 08:27:55.167860 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 175/345] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:54 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:55.265346 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-de15287d-f6d5-4442-a27d-17da38d6b5a1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:55.275014 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-de15287d-f6d5-4442-a27d-17da38d6b5a1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.241165 Jul 20 08:27:55.275556 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 171/346] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:55 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:56.184868 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e1b94493-b777-4f1c-87ff-09258be0c8a8 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:56.185645 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-e1b94493-b777-4f1c-87ff-09258be0c8a8 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:56.192275 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e1b94493-b777-4f1c-87ff-09258be0c8a8 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:56.192863 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e1b94493-b777-4f1c-87ff-09258be0c8a8 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:56.194009 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e1b94493-b777-4f1c-87ff-09258be0c8a8 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:56.194565 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e1b94493-b777-4f1c-87ff-09258be0c8a8 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:56.292995 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-7d5bde41-f4b0-40a9-9536-8a162e39fb3f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:56.293600 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-7d5bde41-f4b0-40a9-9536-8a162e39fb3f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:56.306338 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7d5bde41-f4b0-40a9-9536-8a162e39fb3f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:56.306842 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7d5bde41-f4b0-40a9-9536-8a162e39fb3f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:56.307743 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7d5bde41-f4b0-40a9-9536-8a162e39fb3f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:56.308068 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7d5bde41-f4b0-40a9-9536-8a162e39fb3f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:56.498251 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-7d5bde41-f4b0-40a9-9536-8a162e39fb3f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:56.509731 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-7d5bde41-f4b0-40a9-9536-8a162e39fb3f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.220332 Jul 20 08:27:56.522674 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e1b94493-b777-4f1c-87ff-09258be0c8a8 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:56.526640 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 172/347] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:56 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:56.537877 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e1b94493-b777-4f1c-87ff-09258be0c8a8 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1314 microversion: 2.1 time: 0.357180 Jul 20 08:27:56.538695 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 176/348] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:56 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:57.532099 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-337db0cb-0d1f-42fb-8522-9ef78f8a81ef tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:57.533277 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-337db0cb-0d1f-42fb-8522-9ef78f8a81ef tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:57.544390 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-337db0cb-0d1f-42fb-8522-9ef78f8a81ef tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:57.545196 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-337db0cb-0d1f-42fb-8522-9ef78f8a81ef tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:57.546919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-337db0cb-0d1f-42fb-8522-9ef78f8a81ef tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:57.547714 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-337db0cb-0d1f-42fb-8522-9ef78f8a81ef tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:57.556335 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-280cdc4b-169a-4675-8dd9-463ded863369 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:57.557524 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-280cdc4b-169a-4675-8dd9-463ded863369 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:57.565465 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-280cdc4b-169a-4675-8dd9-463ded863369 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:57.565926 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-280cdc4b-169a-4675-8dd9-463ded863369 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:57.566849 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-280cdc4b-169a-4675-8dd9-463ded863369 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:57.567385 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-280cdc4b-169a-4675-8dd9-463ded863369 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:57.718041 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-337db0cb-0d1f-42fb-8522-9ef78f8a81ef tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:57.729175 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-280cdc4b-169a-4675-8dd9-463ded863369 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:57.735387 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-337db0cb-0d1f-42fb-8522-9ef78f8a81ef tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.208445 Jul 20 08:27:57.736357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 173/349] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:57 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:57.737284 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-280cdc4b-169a-4675-8dd9-463ded863369 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1314 microversion: 2.1 time: 0.185033 Jul 20 08:27:57.738036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 177/350] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:57 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:58.757338 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8765a762-22a7-4948-9fd9-fcfda035124d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:58.757956 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-2672fbce-0445-44e2-9f37-67b86898f76a tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:58.758368 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8765a762-22a7-4948-9fd9-fcfda035124d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:58.758635 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-2672fbce-0445-44e2-9f37-67b86898f76a tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:58.769105 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8765a762-22a7-4948-9fd9-fcfda035124d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:58.769324 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2672fbce-0445-44e2-9f37-67b86898f76a tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:58.769821 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8765a762-22a7-4948-9fd9-fcfda035124d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:58.769934 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2672fbce-0445-44e2-9f37-67b86898f76a tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:58.771098 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2672fbce-0445-44e2-9f37-67b86898f76a tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:58.771263 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8765a762-22a7-4948-9fd9-fcfda035124d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:58.771810 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2672fbce-0445-44e2-9f37-67b86898f76a tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:58.771919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8765a762-22a7-4948-9fd9-fcfda035124d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:58.947254 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2672fbce-0445-44e2-9f37-67b86898f76a tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:58.953667 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8765a762-22a7-4948-9fd9-fcfda035124d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:27:58.959792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-2672fbce-0445-44e2-9f37-67b86898f76a tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1314 microversion: 2.1 time: 0.208664 Jul 20 08:27:58.960468 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 178/351] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:58 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:27:58.967373 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8765a762-22a7-4948-9fd9-fcfda035124d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.217267 Jul 20 08:27:58.969071 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 174/352] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:58 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:27:59.978100 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-815ff2e1-cfa9-4e39-9a9b-71841b796406 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:59.978735 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-815ff2e1-cfa9-4e39-9a9b-71841b796406 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:59.986134 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-815ff2e1-cfa9-4e39-9a9b-71841b796406 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:59.986609 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-815ff2e1-cfa9-4e39-9a9b-71841b796406 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:59.987393 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ba2757f1-d764-4ab7-aa71-94b110bb2d2e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:27:59.987938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-815ff2e1-cfa9-4e39-9a9b-71841b796406 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:59.987938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-815ff2e1-cfa9-4e39-9a9b-71841b796406 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:59.988077 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ba2757f1-d764-4ab7-aa71-94b110bb2d2e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:27:59.994871 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ba2757f1-d764-4ab7-aa71-94b110bb2d2e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:59.995321 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ba2757f1-d764-4ab7-aa71-94b110bb2d2e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:27:59.996101 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ba2757f1-d764-4ab7-aa71-94b110bb2d2e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:27:59.996534 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ba2757f1-d764-4ab7-aa71-94b110bb2d2e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:00.014922 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:28:00.134071 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ba2757f1-d764-4ab7-aa71-94b110bb2d2e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:00.135354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-815ff2e1-cfa9-4e39-9a9b-71841b796406 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:00.142376 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ba2757f1-d764-4ab7-aa71-94b110bb2d2e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.160058 Jul 20 08:28:00.143084 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 175/353] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:59 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:00.143533 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-815ff2e1-cfa9-4e39-9a9b-71841b796406 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1314 microversion: 2.1 time: 0.169274 Jul 20 08:28:00.144094 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 179/354] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:27:59 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:01.159867 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8c553b9b-b573-4fd7-9657-ae1b2721a2c3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:01.160545 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8c553b9b-b573-4fd7-9657-ae1b2721a2c3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:01.160804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a47b5b1a-ee93-4896-b289-2983596410b1 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:01.161405 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a47b5b1a-ee93-4896-b289-2983596410b1 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:01.167671 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8c553b9b-b573-4fd7-9657-ae1b2721a2c3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:01.167938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a47b5b1a-ee93-4896-b289-2983596410b1 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:01.168152 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8c553b9b-b573-4fd7-9657-ae1b2721a2c3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:01.168315 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a47b5b1a-ee93-4896-b289-2983596410b1 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:01.168921 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8c553b9b-b573-4fd7-9657-ae1b2721a2c3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:01.169034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a47b5b1a-ee93-4896-b289-2983596410b1 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:01.169349 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8c553b9b-b573-4fd7-9657-ae1b2721a2c3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:01.169446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a47b5b1a-ee93-4896-b289-2983596410b1 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:01.175566 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:28:01.314226 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8c553b9b-b573-4fd7-9657-ae1b2721a2c3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:01.317604 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a47b5b1a-ee93-4896-b289-2983596410b1 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:01.322942 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8c553b9b-b573-4fd7-9657-ae1b2721a2c3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.167161 Jul 20 08:28:01.323210 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 176/355] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:01 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:01.325831 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a47b5b1a-ee93-4896-b289-2983596410b1 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1497 microversion: 2.1 time: 0.168863 Jul 20 08:28:01.326494 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 180/356] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:01 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:28:02.037651 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-eb0dbc1b-ce02-41e3-a073-500562d0e455 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:02.038337 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-eb0dbc1b-ce02-41e3-a073-500562d0e455 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:02.044641 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-eb0dbc1b-ce02-41e3-a073-500562d0e455 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:02.045090 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-eb0dbc1b-ce02-41e3-a073-500562d0e455 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:02.045863 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-eb0dbc1b-ce02-41e3-a073-500562d0e455 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:02.046868 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-eb0dbc1b-ce02-41e3-a073-500562d0e455 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:02.074515 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-eb0dbc1b-ce02-41e3-a073-500562d0e455 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Going to try to terminate instance {{(pid=117829) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:28:02.185528 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-eb0dbc1b-ce02-41e3-a073-500562d0e455 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 204 len: 0 microversion: 2.1 time: 0.151284 Jul 20 08:28:02.186215 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 177/357] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:28:02 2022] DELETE /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:28:02.197053 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-29fa2910-3bca-4d31-896f-52cd290492bf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:02.197807 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-29fa2910-3bca-4d31-896f-52cd290492bf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:02.205607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-29fa2910-3bca-4d31-896f-52cd290492bf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:02.206403 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-29fa2910-3bca-4d31-896f-52cd290492bf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:02.207853 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-29fa2910-3bca-4d31-896f-52cd290492bf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:02.208627 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-29fa2910-3bca-4d31-896f-52cd290492bf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:02.341077 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ca6b3d8c-b1bd-4960-b043-4e8e1199a61b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:02.342156 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ca6b3d8c-b1bd-4960-b043-4e8e1199a61b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:02.352785 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ca6b3d8c-b1bd-4960-b043-4e8e1199a61b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:02.353320 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ca6b3d8c-b1bd-4960-b043-4e8e1199a61b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:02.354315 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ca6b3d8c-b1bd-4960-b043-4e8e1199a61b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:02.354977 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ca6b3d8c-b1bd-4960-b043-4e8e1199a61b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:02.389214 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-29fa2910-3bca-4d31-896f-52cd290492bf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:02.419077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-29fa2910-3bca-4d31-896f-52cd290492bf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1503 microversion: 2.1 time: 0.227181 Jul 20 08:28:02.420400 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 181/358] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:02 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1503 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:28:02.456438 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f01c326a-a8a8-423d-be7e-9e916b49ca04 tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] Calling method '.version_select at 0x7fe3996b94c0>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:02.516831 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f01c326a-a8a8-423d-be7e-9e916b49ca04 tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/53823e48-1d19-490e-9b09-9087b0f10dc4" status: 200 len: 351 microversion: 2.1 time: 0.064841 Jul 20 08:28:02.517716 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 182/359] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Jul 20 08:28:02 2022] GET /compute/v2.1/os-volumes/53823e48-1d19-490e-9b09-9087b0f10dc4 => generated 351 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:28:02.557215 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ca6b3d8c-b1bd-4960-b043-4e8e1199a61b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:02.571323 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ca6b3d8c-b1bd-4960-b043-4e8e1199a61b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.234365 Jul 20 08:28:02.574628 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 178/360] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:02 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:03.446749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9d752a6a-d265-43fa-a416-0a4af548c8f6 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:03.448041 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9d752a6a-d265-43fa-a416-0a4af548c8f6 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:03.460258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9d752a6a-d265-43fa-a416-0a4af548c8f6 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:03.461412 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9d752a6a-d265-43fa-a416-0a4af548c8f6 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:03.464131 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9d752a6a-d265-43fa-a416-0a4af548c8f6 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:03.465367 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9d752a6a-d265-43fa-a416-0a4af548c8f6 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:03.599300 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-cb73ca06-d43c-4ad0-8669-e84a7ec03b2c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:03.600722 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-cb73ca06-d43c-4ad0-8669-e84a7ec03b2c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:03.611394 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cb73ca06-d43c-4ad0-8669-e84a7ec03b2c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:03.611839 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cb73ca06-d43c-4ad0-8669-e84a7ec03b2c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:03.612622 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cb73ca06-d43c-4ad0-8669-e84a7ec03b2c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:03.613051 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cb73ca06-d43c-4ad0-8669-e84a7ec03b2c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:03.682751 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9d752a6a-d265-43fa-a416-0a4af548c8f6 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:03.692094 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9d752a6a-d265-43fa-a416-0a4af548c8f6 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1503 microversion: 2.1 time: 0.255206 Jul 20 08:28:03.693008 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 183/361] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:03 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1503 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:03.799986 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-cb73ca06-d43c-4ad0-8669-e84a7ec03b2c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:03.809547 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-cb73ca06-d43c-4ad0-8669-e84a7ec03b2c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.215963 Jul 20 08:28:03.810229 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 179/362] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:03 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:28:03.891943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d9dea7a2-afed-490c-8a9e-41c0754ed1d8 tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] Calling method '.version_select at 0x7fe3996b9550>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:03.953354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d9dea7a2-afed-490c-8a9e-41c0754ed1d8 tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/c372a679-43af-4db7-bb23-85b15b087d64" status: 200 len: 350 microversion: 2.1 time: 0.066105 Jul 20 08:28:03.954200 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 184/363] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Jul 20 08:28:03 2022] GET /compute/v2.1/os-volumes/c372a679-43af-4db7-bb23-85b15b087d64 => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:28:04.711365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-aebb863d-390b-4367-b2a2-95b0ed7ce30e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:04.712487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-aebb863d-390b-4367-b2a2-95b0ed7ce30e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:04.722250 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aebb863d-390b-4367-b2a2-95b0ed7ce30e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:04.723205 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aebb863d-390b-4367-b2a2-95b0ed7ce30e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:04.724262 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aebb863d-390b-4367-b2a2-95b0ed7ce30e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:04.725081 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aebb863d-390b-4367-b2a2-95b0ed7ce30e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:04.830528 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b0da49a2-6cc2-468f-86a8-b3229cb76a21 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:04.831749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b0da49a2-6cc2-468f-86a8-b3229cb76a21 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:04.839562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b0da49a2-6cc2-468f-86a8-b3229cb76a21 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:04.840017 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b0da49a2-6cc2-468f-86a8-b3229cb76a21 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:04.840815 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b0da49a2-6cc2-468f-86a8-b3229cb76a21 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:04.841250 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b0da49a2-6cc2-468f-86a8-b3229cb76a21 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:04.863798 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-aebb863d-390b-4367-b2a2-95b0ed7ce30e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:04.872478 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-aebb863d-390b-4367-b2a2-95b0ed7ce30e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 200 len: 1461 microversion: 2.1 time: 0.165558 Jul 20 08:28:04.875583 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 180/364] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:04 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 1461 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:04.920427 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-b58946a0-0166-4c34-9b10-78989068a218 req-819bfc5b-2ccd-4840-a1da-44b36341e9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8273f04-3311-466c-b48f-149757006ab9", "name": "network-vif-deleted", "tag": "eb6642d2-1021-40f3-a3d6-2143e5810bff"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:28:04.931797 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-b58946a0-0166-4c34-9b10-78989068a218 req-819bfc5b-2ccd-4840-a1da-44b36341e9f4 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:04.932243 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-b58946a0-0166-4c34-9b10-78989068a218 req-819bfc5b-2ccd-4840-a1da-44b36341e9f4 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:04.947355 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-b58946a0-0166-4c34-9b10-78989068a218 req-819bfc5b-2ccd-4840-a1da-44b36341e9f4 service nova] Creating event network-vif-deleted:eb6642d2-1021-40f3-a3d6-2143e5810bff for instance d8273f04-3311-466c-b48f-149757006ab9 on hv-cinder-82308 Jul 20 08:28:04.952296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-b58946a0-0166-4c34-9b10-78989068a218 req-819bfc5b-2ccd-4840-a1da-44b36341e9f4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035954 Jul 20 08:28:04.953565 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 181/365] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:28:05.127821 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b0da49a2-6cc2-468f-86a8-b3229cb76a21 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:05.145712 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b0da49a2-6cc2-468f-86a8-b3229cb76a21 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.321338 Jul 20 08:28:05.148057 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 185/366] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:04 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:05.393659 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-53ba34ac-7c1e-4c38-97db-1ca1a36ed27b tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] Calling method '.version_select at 0x7fe39a97d430>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:05.456984 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-53ba34ac-7c1e-4c38-97db-1ca1a36ed27b tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/420b4807-6866-4a64-a6b1-07ef769c4458" status: 200 len: 350 microversion: 2.1 time: 0.067682 Jul 20 08:28:05.457650 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 182/367] 10.222.0.64 () {58 vars in 1244 bytes} [Wed Jul 20 08:28:05 2022] GET /compute/v2.1/os-volumes/420b4807-6866-4a64-a6b1-07ef769c4458 => generated 350 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:28:05.478959 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-59910220-7aac-4b21-b0c1-72ab86fe498f tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] Calling method '.version_select at 0x7fe3996b91f0>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:05.665156 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-59910220-7aac-4b21-b0c1-72ab86fe498f tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.198220 Jul 20 08:28:05.666223 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 186/368] 10.222.0.64 () {58 vars in 1133 bytes} [Wed Jul 20 08:28:05 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:05.685123 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9bdcd221-9096-4a3f-be77-0363d341442d tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] Calling method '.version_select at 0x7fe39a0155e0>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:05.790283 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9bdcd221-9096-4a3f-be77-0363d341442d tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.110409 Jul 20 08:28:05.791020 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 183/369] 10.222.0.64 () {58 vars in 1148 bytes} [Wed Jul 20 08:28:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:28:05.809593 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0a7e6361-0e42-4ef7-86ec-a1e51fd81364 tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] Calling method '.version_select at 0x7fe3996b7e50>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:05.895261 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3e1c0a91-7f87-4a80-a1eb-348bc8091fdf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:05.896271 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3e1c0a91-7f87-4a80-a1eb-348bc8091fdf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: d8273f04-3311-466c-b48f-149757006ab9] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:05.904708 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3e1c0a91-7f87-4a80-a1eb-348bc8091fdf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:05.905402 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3e1c0a91-7f87-4a80-a1eb-348bc8091fdf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:05.906471 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3e1c0a91-7f87-4a80-a1eb-348bc8091fdf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:05.907313 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3e1c0a91-7f87-4a80-a1eb-348bc8091fdf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:05.919149 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0a7e6361-0e42-4ef7-86ec-a1e51fd81364 tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.115959 Jul 20 08:28:05.926130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 187/370] 10.222.0.64 () {58 vars in 1133 bytes} [Wed Jul 20 08:28:05 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:05.930834 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-3e1c0a91-7f87-4a80-a1eb-348bc8091fdf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] HTTP exception thrown: Instance d8273f04-3311-466c-b48f-149757006ab9 could not be found. Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3e1c0a91-7f87-4a80-a1eb-348bc8091fdf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Request method failure captured: Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 HTTP/1.1 Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17xuvIkbC4r7pu_2TlUAx6P2onBPaVX_ERbKhDn2ykBSlpnP7Abr_wr006iGNd6dhOsCIczuWK0fO3hKIk0L65tSOvRvvGL53DtRPQ6zFuNCAyPSNn4skbsQjjs7UzgOWIS8egAGrbTZFtUtyg7Kbz8Z2IEA2hfrTjk89m-aK5irXdw Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: 02622d333fa24a0bbd1ef6f59276ba77 Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-VolumesActionsTest-1676923366 Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:28:05.932759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:28:05.934004 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/02622d333fa24a0bbd1ef6f59276ba77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/02622d333fa24a0bbd1ef6f59276ba77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_02622d333fa24a0bbd1ef6f59276ba77", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/02622d333fa24a0bbd1ef6f59276ba77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:28:05.934004 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-VolumesActionsTest-1676923366 Jul 20 08:28:05.934004 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: 02622d333fa24a0bbd1ef6f59276ba77 Jul 20 08:28:05.934004 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-VolumesActionsTest-1676923366 Jul 20 08:28:05.934004 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-VolumesActionsTest-1676923366-project Jul 20 08:28:05.934004 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:28:05.934004 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:28:05.934004 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: d88c5f05aab0458d8dc0a285bce33f28 Jul 20 08:28:05.934004 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-VolumesActionsTest-1676923366-project Jul 20 08:28:05.934004 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: > Jul 20 08:28:05.934004 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Instance d8273f04-3311-466c-b48f-149757006ab9 could not be found. Jul 20 08:28:05.934004 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': 'd8273f04-3311-466c-b48f-149757006ab9'} Jul 20 08:28:05.934820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:28:05.934820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:28:05.934820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:28:05.934820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:28:05.934820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:28:05.934820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:28:05.934820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:28:05.934820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:28:05.934820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:28:05.934820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:28:05.934820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8273f04-3311-466c-b48f-149757006ab9 could not be found. Jul 20 08:28:05.934820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:28:05.934820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:28:05.934820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:28:05.934820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:28:05.934820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:28:05.934820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:28:05.934820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:28:05.934820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:28:05.934820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:28:05.935920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:28:05.935920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:28:05.935920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:28:05.935920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:28:05.935920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:28:05.935920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:28:05.935920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:28:05.935920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8273f04-3311-466c-b48f-149757006ab9 could not be found. Jul 20 08:28:05.935920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:28:05.935920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:28:05.935920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:28:05.935920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:28:05.935920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:28:05.935920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:28:05.935920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:28:05.935920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:28:05.935920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8273f04-3311-466c-b48f-149757006ab9 could not be found. Jul 20 08:28:05.935920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:28:05.938751 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3e1c0a91-7f87-4a80-a1eb-348bc8091fdf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Returning 404 to user: Instance d8273f04-3311-466c-b48f-149757006ab9 could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:28:05.939627 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3e1c0a91-7f87-4a80-a1eb-348bc8091fdf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9" status: 404 len: 111 microversion: 2.1 time: 0.048536 Jul 20 08:28:05.943760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 184/371] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:05 2022] GET /compute/v2.1/servers/d8273f04-3311-466c-b48f-149757006ab9 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:28:05.943962 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-89236b4a-64b0-4d9b-9468-d76574657c72 tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] Calling method '.version_select at 0x7fe3996b05e0>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:06.054065 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-89236b4a-64b0-4d9b-9468-d76574657c72 tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.125776 Jul 20 08:28:06.054897 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 188/372] 10.222.0.64 () {58 vars in 1166 bytes} [Wed Jul 20 08:28:05 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:28:06.068395 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-dd7f584a-a99f-49c7-9fc1-c19261c3fd62 tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] Calling method '.version_select at 0x7fe399febee0>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:06.152795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-20e129f0-c5c2-4e2a-82ad-68ec4a079a2e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-702799615", "imageRef": "5d6b971e-8afe-4e4a-b054-20cd61970c65", "flavorRef": "452", "networks": [{"uuid": "9eed6757-1d3b-47bb-9daf-5c99f31991f4"}]}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:28:06.166809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-dd7f584a-a99f-49c7-9fc1-c19261c3fd62 tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.102619 Jul 20 08:28:06.167604 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 185/373] 10.222.0.64 () {58 vars in 1169 bytes} [Wed Jul 20 08:28:06 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:28:06.180051 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-7fc10e6b-6c54-4f28-843f-597447d7b785 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:06.180702 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-7fc10e6b-6c54-4f28-843f-597447d7b785 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:06.198836 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7fc10e6b-6c54-4f28-843f-597447d7b785 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:06.199251 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7fc10e6b-6c54-4f28-843f-597447d7b785 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:06.200071 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7fc10e6b-6c54-4f28-843f-597447d7b785 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:06.200517 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7fc10e6b-6c54-4f28-843f-597447d7b785 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:06.236560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.network.neutron [None req-20e129f0-c5c2-4e2a-82ad-68ec4a079a2e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] validate_networks() for [('9eed6757-1d3b-47bb-9daf-5c99f31991f4', None, None, None, None, None)] {{(pid=117828) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:28:06.399154 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-7fc10e6b-6c54-4f28-843f-597447d7b785 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:06.413900 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-7fc10e6b-6c54-4f28-843f-597447d7b785 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.237682 Jul 20 08:28:06.417660 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 186/374] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:06 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:06.430151 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-fdab366e-ae5f-45b8-badb-50d39c8ad6fe tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] Calling method '.version_select at 0x7fe399feb790>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:06.550169 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-fdab366e-ae5f-45b8-badb-50d39c8ad6fe tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.130639 Jul 20 08:28:06.551503 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 187/375] 10.222.0.64 () {58 vars in 1154 bytes} [Wed Jul 20 08:28:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:06.564319 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-eeb7c844-53d6-4a60-8ad8-99fc3027e17a tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] Calling method '.version_select at 0x7fe39a97d310>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:06.705053 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-eeb7c844-53d6-4a60-8ad8-99fc3027e17a tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.145166 Jul 20 08:28:06.706073 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 188/376] 10.222.0.64 () {58 vars in 1187 bytes} [Wed Jul 20 08:28:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:28:06.717356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4d509da4-3204-4d14-8913-67e8c44e16eb tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] Calling method '.version_select at 0x7fe39a03ed30>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:06.826465 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4d509da4-3204-4d14-8913-67e8c44e16eb tempest-VolumesTestJSON-1299326740 tempest-VolumesTestJSON-1299326740-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.112593 Jul 20 08:28:06.827559 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 189/377] 10.222.0.64 () {58 vars in 1154 bytes} [Wed Jul 20 08:28:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:06.897691 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-20e129f0-c5c2-4e2a-82ad-68ec4a079a2e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Flavor limits 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:28:06.898558 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-20e129f0-c5c2-4e2a-82ad-68ec4a079a2e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Image limits 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:28:06.899236 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-20e129f0-c5c2-4e2a-82ad-68ec4a079a2e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Flavor pref 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:28:06.899750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-20e129f0-c5c2-4e2a-82ad-68ec4a079a2e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Image pref 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:28:06.900299 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-20e129f0-c5c2-4e2a-82ad-68ec4a079a2e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:28:06.911990 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-20e129f0-c5c2-4e2a-82ad-68ec4a079a2e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:06.912616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-20e129f0-c5c2-4e2a-82ad-68ec4a079a2e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:06.913600 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-20e129f0-c5c2-4e2a-82ad-68ec4a079a2e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:06.914097 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-20e129f0-c5c2-4e2a-82ad-68ec4a079a2e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:06.939365 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-20e129f0-c5c2-4e2a-82ad-68ec4a079a2e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Getting quotas for project 02622d333fa24a0bbd1ef6f59276ba77. Resources: {'cores', 'ram', 'instances'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:28:06.946768 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-20e129f0-c5c2-4e2a-82ad-68ec4a079a2e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Getting quotas for user d88c5f05aab0458d8dc0a285bce33f28 and project 02622d333fa24a0bbd1ef6f59276ba77. Resources: {'cores', 'ram', 'instances'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:28:06.965388 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-20e129f0-c5c2-4e2a-82ad-68ec4a079a2e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Going to run 1 instances... {{(pid=117828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:28:06.967879 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-20e129f0-c5c2-4e2a-82ad-68ec4a079a2e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d6b971e-8afe-4e4a-b054-20cd61970c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:28:07.018983 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-20e129f0-c5c2-4e2a-82ad-68ec4a079a2e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.869865 Jul 20 08:28:07.019969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 189/378] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Jul 20 08:28:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 08:28:07.029606 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d5aebfe7-3628-4b9e-810b-b4528af9ac45 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:07.030207 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d5aebfe7-3628-4b9e-810b-b4528af9ac45 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:07.091702 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d5aebfe7-3628-4b9e-810b-b4528af9ac45 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:07.100028 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d5aebfe7-3628-4b9e-810b-b4528af9ac45 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1213 microversion: 2.1 time: 0.074195 Jul 20 08:28:07.100609 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 190/379] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:07 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:07.435805 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-896a7569-ebc7-485f-8f30-51fc7f805049 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:07.436419 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-896a7569-ebc7-485f-8f30-51fc7f805049 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:07.438543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:28:07.444659 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-896a7569-ebc7-485f-8f30-51fc7f805049 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:07.445198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-896a7569-ebc7-485f-8f30-51fc7f805049 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:07.445979 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-896a7569-ebc7-485f-8f30-51fc7f805049 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:07.446417 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-896a7569-ebc7-485f-8f30-51fc7f805049 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:07.594469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-896a7569-ebc7-485f-8f30-51fc7f805049 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:07.603123 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-896a7569-ebc7-485f-8f30-51fc7f805049 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.171215 Jul 20 08:28:07.603857 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 190/380] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:07 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:08.118048 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e2271211-7f0f-4dc4-8b8c-017efb832d19 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:08.118644 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e2271211-7f0f-4dc4-8b8c-017efb832d19 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:08.125539 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e2271211-7f0f-4dc4-8b8c-017efb832d19 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:08.126006 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e2271211-7f0f-4dc4-8b8c-017efb832d19 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:08.126818 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e2271211-7f0f-4dc4-8b8c-017efb832d19 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:08.127582 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e2271211-7f0f-4dc4-8b8c-017efb832d19 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:08.208526 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e2271211-7f0f-4dc4-8b8c-017efb832d19 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:08.216650 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e2271211-7f0f-4dc4-8b8c-017efb832d19 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1273 microversion: 2.1 time: 0.102557 Jul 20 08:28:08.217224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 191/381] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:08 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1273 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:08.621816 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3ee39c6b-12f3-4c2b-805e-d3fc896787d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:08.622434 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-3ee39c6b-12f3-4c2b-805e-d3fc896787d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:08.631627 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ee39c6b-12f3-4c2b-805e-d3fc896787d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:08.632221 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ee39c6b-12f3-4c2b-805e-d3fc896787d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:08.633115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ee39c6b-12f3-4c2b-805e-d3fc896787d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:08.633634 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ee39c6b-12f3-4c2b-805e-d3fc896787d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:08.792669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3ee39c6b-12f3-4c2b-805e-d3fc896787d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:08.801559 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-3ee39c6b-12f3-4c2b-805e-d3fc896787d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.183745 Jul 20 08:28:08.802406 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 191/382] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:08 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:09.237744 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c5319097-8313-4d16-ade4-ac394370a659 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:09.238360 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c5319097-8313-4d16-ade4-ac394370a659 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:09.245367 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c5319097-8313-4d16-ade4-ac394370a659 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:09.245791 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c5319097-8313-4d16-ade4-ac394370a659 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:09.246565 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c5319097-8313-4d16-ade4-ac394370a659 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:09.247131 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c5319097-8313-4d16-ade4-ac394370a659 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:09.315120 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c5319097-8313-4d16-ade4-ac394370a659 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:09.323049 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c5319097-8313-4d16-ade4-ac394370a659 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1273 microversion: 2.1 time: 0.089937 Jul 20 08:28:09.323620 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 192/383] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:09 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:09.819183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9675cb9b-e031-4c5b-b755-61d3d3329e37 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:09.819896 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9675cb9b-e031-4c5b-b755-61d3d3329e37 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:09.825986 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9675cb9b-e031-4c5b-b755-61d3d3329e37 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:09.826430 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9675cb9b-e031-4c5b-b755-61d3d3329e37 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:09.827233 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9675cb9b-e031-4c5b-b755-61d3d3329e37 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:09.827707 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9675cb9b-e031-4c5b-b755-61d3d3329e37 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:09.972280 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9675cb9b-e031-4c5b-b755-61d3d3329e37 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:09.980212 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9675cb9b-e031-4c5b-b755-61d3d3329e37 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.164862 Jul 20 08:28:09.992015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 192/384] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:09 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:10.358520 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6cd0983b-1bc3-47e0-a67c-7572e1f07f1b tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:10.358520 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6cd0983b-1bc3-47e0-a67c-7572e1f07f1b tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:10.360186 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:28:10.370218 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6cd0983b-1bc3-47e0-a67c-7572e1f07f1b tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:10.370729 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6cd0983b-1bc3-47e0-a67c-7572e1f07f1b tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:10.371542 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6cd0983b-1bc3-47e0-a67c-7572e1f07f1b tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:10.371968 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6cd0983b-1bc3-47e0-a67c-7572e1f07f1b tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:10.470119 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6cd0983b-1bc3-47e0-a67c-7572e1f07f1b tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:10.480017 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6cd0983b-1bc3-47e0-a67c-7572e1f07f1b tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1271 microversion: 2.1 time: 0.137538 Jul 20 08:28:10.480859 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 193/385] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:10 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1271 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:10.999206 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8118919e-1a52-437a-9a87-a36b57fb332a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:10.999813 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8118919e-1a52-437a-9a87-a36b57fb332a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:11.006639 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8118919e-1a52-437a-9a87-a36b57fb332a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:11.007100 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8118919e-1a52-437a-9a87-a36b57fb332a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:11.007874 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8118919e-1a52-437a-9a87-a36b57fb332a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:11.008312 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8118919e-1a52-437a-9a87-a36b57fb332a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:11.143605 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-8118919e-1a52-437a-9a87-a36b57fb332a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:11.151287 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8118919e-1a52-437a-9a87-a36b57fb332a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.156030 Jul 20 08:28:11.151862 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 193/386] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:10 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:11.504487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9279e78b-cc53-43ce-8cd1-3364a5fe24ea tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:11.505381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9279e78b-cc53-43ce-8cd1-3364a5fe24ea tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:11.513896 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9279e78b-cc53-43ce-8cd1-3364a5fe24ea tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:11.514346 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9279e78b-cc53-43ce-8cd1-3364a5fe24ea tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:11.515215 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9279e78b-cc53-43ce-8cd1-3364a5fe24ea tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:11.516030 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9279e78b-cc53-43ce-8cd1-3364a5fe24ea tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:11.889830 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9279e78b-cc53-43ce-8cd1-3364a5fe24ea tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:11.905780 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9279e78b-cc53-43ce-8cd1-3364a5fe24ea tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.405928 Jul 20 08:28:11.907098 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 194/387] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:11 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:12.168597 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9827b56f-42c6-4b38-abc6-ba3256fc2672 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:12.169880 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9827b56f-42c6-4b38-abc6-ba3256fc2672 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:12.178374 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9827b56f-42c6-4b38-abc6-ba3256fc2672 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:12.179053 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9827b56f-42c6-4b38-abc6-ba3256fc2672 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:12.180322 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9827b56f-42c6-4b38-abc6-ba3256fc2672 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:12.181219 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9827b56f-42c6-4b38-abc6-ba3256fc2672 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:12.345112 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9827b56f-42c6-4b38-abc6-ba3256fc2672 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:12.358292 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9827b56f-42c6-4b38-abc6-ba3256fc2672 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1502 microversion: 2.1 time: 0.193357 Jul 20 08:28:12.359519 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 194/388] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:12 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1502 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:12.385536 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3c4144bb-22d8-4d6c-8ca4-99ad5b5bd2a6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b439248b-d12f-41b5-ada9-e64e1fcd8d7a"}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:28:12.386719 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3c4144bb-22d8-4d6c-8ca4-99ad5b5bd2a6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:12.395592 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3c4144bb-22d8-4d6c-8ca4-99ad5b5bd2a6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:12.396131 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3c4144bb-22d8-4d6c-8ca4-99ad5b5bd2a6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:12.397162 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3c4144bb-22d8-4d6c-8ca4-99ad5b5bd2a6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:12.397634 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3c4144bb-22d8-4d6c-8ca4-99ad5b5bd2a6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:12.425995 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-e048b435-a7cf-489c-a30a-1b9fcb410feb req-87d1db47-6c38-4124-bbfd-a8c1316f80ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f468975-0a18-49f7-a45c-b5973ea35837", "tag": "802be1bc-be90-4f26-8cb8-b64bfed9f1f7"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:28:12.432913 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-3c4144bb-22d8-4d6c-8ca4-99ad5b5bd2a6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] HTTP exception thrown: Cannot 'attach_volume' instance ff2ea553-bf93-4f6e-b624-935ecec595b7 while it is in vm_state rescued Jul 20 08:28:12.435138 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-e048b435-a7cf-489c-a30a-1b9fcb410feb req-87d1db47-6c38-4124-bbfd-a8c1316f80ec service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3c4144bb-22d8-4d6c-8ca4-99ad5b5bd2a6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Request method failure captured: Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: POST /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7/os-volume_attachments HTTP/1.1 Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 74 Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17wLWBpeoKgfzdsi51_hIXGB8-8_ob4HBeMDTAoZXmbR9OTdLGoz8lraAbtA1VljznsqFm8mBeIJ78unFupJffa1Ph7RVWc5vPV_d-advUcTKgjrXktbtRaRuqi5OFUWnxKh_KRm9Y1lpwiWhLhvcvORrKWnqxeDw0PGarPIqsdcU-4 Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: b044b1d7d5474351bd94eb1c90882933 Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-762570368 Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:28:12.435257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:28:12.436426 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b044b1d7d5474351bd94eb1c90882933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b044b1d7d5474351bd94eb1c90882933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b044b1d7d5474351bd94eb1c90882933", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b044b1d7d5474351bd94eb1c90882933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:28:12.436426 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-ServerRescueNegativeTestJSON-762570368 Jul 20 08:28:12.436426 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: b044b1d7d5474351bd94eb1c90882933 Jul 20 08:28:12.436426 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-762570368 Jul 20 08:28:12.436426 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-ServerRescueNegativeTestJSON-762570368-project Jul 20 08:28:12.436426 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:28:12.436426 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:28:12.436426 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: bdc9e59d03334b72a8052e0f1112523f Jul 20 08:28:12.436426 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-ServerRescueNegativeTestJSON-762570368-project Jul 20 08:28:12.436426 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Jul 20 08:28:12.436426 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {"volumeAttachment": {"volumeId": "b439248b-d12f-41b5-ada9-e64e1fcd8d7a"}} Jul 20 08:28:12.436426 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: > Jul 20 08:28:12.437285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Cannot 'attach_volume' instance ff2ea553-bf93-4f6e-b624-935ecec595b7 while it is in vm_state rescued Jul 20 08:28:12.437285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'server_id': 'ff2ea553-bf93-4f6e-b624-935ecec595b7', 'body': {'volumeAttachment': {'volumeId': 'b439248b-d12f-41b5-ada9-e64e1fcd8d7a'}}} Jul 20 08:28:12.437285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:28:12.437285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:28:12.437285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 08:28:12.437285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 08:28:12.437285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 08:28:12.437285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 08:28:12.437285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 08:28:12.437285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 08:28:12.437285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ff2ea553-bf93-4f6e-b624-935ecec595b7 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 20 08:28:12.437285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:28:12.437285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:28:12.437285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:28:12.437285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:28:12.437285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:28:12.437285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:28:12.437285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:28:12.437285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:28:12.439686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:28:12.439686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:28:12.439686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 08:28:12.439686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 08:28:12.439686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 08:28:12.439686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 08:28:12.439686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 08:28:12.439686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 08:28:12.439686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 20 08:28:12.439686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 08:28:12.439686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 08:28:12.439686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 08:28:12.439686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ff2ea553-bf93-4f6e-b624-935ecec595b7 while it is in vm_state rescued Jul 20 08:28:12.439686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:28:12.439686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:28:12.439686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:28:12.439686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:28:12.439686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:28:12.439686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:28:12.440704 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:28:12.440704 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:28:12.440704 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ff2ea553-bf93-4f6e-b624-935ecec595b7 while it is in vm_state rescued Jul 20 08:28:12.440704 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:28:12.440944 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-e048b435-a7cf-489c-a30a-1b9fcb410feb req-87d1db47-6c38-4124-bbfd-a8c1316f80ec service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:12.441021 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3c4144bb-22d8-4d6c-8ca4-99ad5b5bd2a6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Returning 409 to user: Cannot 'attach_volume' instance ff2ea553-bf93-4f6e-b624-935ecec595b7 while it is in vm_state rescued {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:28:12.443033 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3c4144bb-22d8-4d6c-8ca4-99ad5b5bd2a6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "POST /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055877 Jul 20 08:28:12.444013 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 195/389] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Jul 20 08:28:12 2022] POST /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7/os-volume_attachments => generated 152 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 20 08:28:12.453571 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-be0292e3-f715-49d5-9507-6ba9050e79dd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:28:12.454124 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-be0292e3-f715-49d5-9507-6ba9050e79dd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:12.455988 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-e048b435-a7cf-489c-a30a-1b9fcb410feb req-87d1db47-6c38-4124-bbfd-a8c1316f80ec service nova] Creating event network-changed:802be1bc-be90-4f26-8cb8-b64bfed9f1f7 for instance 0f468975-0a18-49f7-a45c-b5973ea35837 on hv-cinder-82308 Jul 20 08:28:12.462622 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-e048b435-a7cf-489c-a30a-1b9fcb410feb req-87d1db47-6c38-4124-bbfd-a8c1316f80ec service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043759 Jul 20 08:28:12.463661 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 195/390] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:28:12.476733 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-be0292e3-f715-49d5-9507-6ba9050e79dd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:12.477621 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-be0292e3-f715-49d5-9507-6ba9050e79dd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:12.478526 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-be0292e3-f715-49d5-9507-6ba9050e79dd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:12.478880 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-be0292e3-f715-49d5-9507-6ba9050e79dd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:12.561651 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-be0292e3-f715-49d5-9507-6ba9050e79dd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "POST /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7/action" status: 202 len: 0 microversion: 2.1 time: 0.112766 Jul 20 08:28:12.565992 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 196/391] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Jul 20 08:28:12 2022] POST /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 08:28:12.572458 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-21d2935f-c8a0-45df-9767-a7d2b8999bc8 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:12.573323 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-21d2935f-c8a0-45df-9767-a7d2b8999bc8 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:12.580413 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-21d2935f-c8a0-45df-9767-a7d2b8999bc8 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:12.580977 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-21d2935f-c8a0-45df-9767-a7d2b8999bc8 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:12.581755 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-21d2935f-c8a0-45df-9767-a7d2b8999bc8 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:12.582175 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-21d2935f-c8a0-45df-9767-a7d2b8999bc8 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:12.745586 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-21d2935f-c8a0-45df-9767-a7d2b8999bc8 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:12.754221 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-21d2935f-c8a0-45df-9767-a7d2b8999bc8 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1510 microversion: 2.1 time: 0.186131 Jul 20 08:28:12.754842 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 196/392] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:12 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:12.926603 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9ce6b86a-4685-4bff-b68f-de0377bdc624 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:12.927920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9ce6b86a-4685-4bff-b68f-de0377bdc624 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:12.935333 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9ce6b86a-4685-4bff-b68f-de0377bdc624 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:12.936216 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9ce6b86a-4685-4bff-b68f-de0377bdc624 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:12.937346 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9ce6b86a-4685-4bff-b68f-de0377bdc624 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:12.938244 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9ce6b86a-4685-4bff-b68f-de0377bdc624 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:13.278158 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9ce6b86a-4685-4bff-b68f-de0377bdc624 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:13.288544 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9ce6b86a-4685-4bff-b68f-de0377bdc624 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.367639 Jul 20 08:28:13.289850 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 197/393] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:12 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:13.777680 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3ecac9b5-6f70-45b2-9e64-e7042b1c6881 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:13.780060 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-3ecac9b5-6f70-45b2-9e64-e7042b1c6881 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:13.792328 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ecac9b5-6f70-45b2-9e64-e7042b1c6881 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:13.793184 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ecac9b5-6f70-45b2-9e64-e7042b1c6881 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:13.794676 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ecac9b5-6f70-45b2-9e64-e7042b1c6881 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:13.795769 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ecac9b5-6f70-45b2-9e64-e7042b1c6881 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:14.020816 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3ecac9b5-6f70-45b2-9e64-e7042b1c6881 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:14.035205 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-3ecac9b5-6f70-45b2-9e64-e7042b1c6881 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1510 microversion: 2.1 time: 0.265083 Jul 20 08:28:14.035747 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 197/394] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:13 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1510 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:28:14.317399 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-483e1a2a-cf5b-4ce7-b355-3698a35134bf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:14.318320 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-483e1a2a-cf5b-4ce7-b355-3698a35134bf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:14.340637 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-483e1a2a-cf5b-4ce7-b355-3698a35134bf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:14.341321 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-483e1a2a-cf5b-4ce7-b355-3698a35134bf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:14.342355 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-483e1a2a-cf5b-4ce7-b355-3698a35134bf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:14.344527 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-483e1a2a-cf5b-4ce7-b355-3698a35134bf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:14.353536 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:28:14.679361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-483e1a2a-cf5b-4ce7-b355-3698a35134bf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:14.686656 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-483e1a2a-cf5b-4ce7-b355-3698a35134bf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.383484 Jul 20 08:28:14.687279 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 198/395] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:14 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:15.052794 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-57469c7d-d196-4417-8bfd-d2e6132284ab tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:15.053594 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-57469c7d-d196-4417-8bfd-d2e6132284ab tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:15.065398 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-57469c7d-d196-4417-8bfd-d2e6132284ab tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:15.065842 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-57469c7d-d196-4417-8bfd-d2e6132284ab tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:15.066649 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-57469c7d-d196-4417-8bfd-d2e6132284ab tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:15.067320 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-57469c7d-d196-4417-8bfd-d2e6132284ab tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:15.213140 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-57469c7d-d196-4417-8bfd-d2e6132284ab tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:15.221607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-57469c7d-d196-4417-8bfd-d2e6132284ab tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1510 microversion: 2.1 time: 0.172807 Jul 20 08:28:15.222177 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 198/396] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:15 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1510 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:15.704789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c2ab47b2-00e3-47b1-9ac0-e18b31d5b74f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:15.705664 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c2ab47b2-00e3-47b1-9ac0-e18b31d5b74f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:15.712155 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c2ab47b2-00e3-47b1-9ac0-e18b31d5b74f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:15.712744 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c2ab47b2-00e3-47b1-9ac0-e18b31d5b74f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:15.713517 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c2ab47b2-00e3-47b1-9ac0-e18b31d5b74f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:15.713948 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c2ab47b2-00e3-47b1-9ac0-e18b31d5b74f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:15.861294 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c2ab47b2-00e3-47b1-9ac0-e18b31d5b74f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:15.869027 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c2ab47b2-00e3-47b1-9ac0-e18b31d5b74f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.169448 Jul 20 08:28:15.875651 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 199/397] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:15 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:16.239492 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9ffa1637-e2d6-4962-af05-8380da8f875d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:16.240089 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9ffa1637-e2d6-4962-af05-8380da8f875d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:16.246632 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9ffa1637-e2d6-4962-af05-8380da8f875d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:16.247992 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9ffa1637-e2d6-4962-af05-8380da8f875d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:16.249034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9ffa1637-e2d6-4962-af05-8380da8f875d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:16.249715 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9ffa1637-e2d6-4962-af05-8380da8f875d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:16.400994 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9ffa1637-e2d6-4962-af05-8380da8f875d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:16.409546 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9ffa1637-e2d6-4962-af05-8380da8f875d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1510 microversion: 2.1 time: 0.173790 Jul 20 08:28:16.413416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 199/398] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:16 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:16.886522 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-546cd634-66fa-4752-bbe4-4859106ea853 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:16.887146 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-546cd634-66fa-4752-bbe4-4859106ea853 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:16.894890 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-546cd634-66fa-4752-bbe4-4859106ea853 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:16.895330 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-546cd634-66fa-4752-bbe4-4859106ea853 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:16.896094 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-546cd634-66fa-4752-bbe4-4859106ea853 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:16.896521 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-546cd634-66fa-4752-bbe4-4859106ea853 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:17.035307 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-546cd634-66fa-4752-bbe4-4859106ea853 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:17.042912 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-546cd634-66fa-4752-bbe4-4859106ea853 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.160316 Jul 20 08:28:17.043492 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 200/399] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:16 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:17.426678 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8a0907e1-3236-4629-a593-d4301663074a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:17.427210 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8a0907e1-3236-4629-a593-d4301663074a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:17.429118 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=2 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:28:17.429964 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=6 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:28:17.435825 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8a0907e1-3236-4629-a593-d4301663074a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:17.436275 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8a0907e1-3236-4629-a593-d4301663074a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:17.437576 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8a0907e1-3236-4629-a593-d4301663074a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:17.438061 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8a0907e1-3236-4629-a593-d4301663074a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:17.573880 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-8a0907e1-3236-4629-a593-d4301663074a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:17.581883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8a0907e1-3236-4629-a593-d4301663074a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1510 microversion: 2.1 time: 0.159225 Jul 20 08:28:17.582450 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 200/400] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:17 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:18.060564 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-67faae81-d12a-4410-8fad-07672b80ae44 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:18.061164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-67faae81-d12a-4410-8fad-07672b80ae44 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:18.067222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=2 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:28:18.069206 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-67faae81-d12a-4410-8fad-07672b80ae44 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:18.069657 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-67faae81-d12a-4410-8fad-07672b80ae44 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:18.070523 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-67faae81-d12a-4410-8fad-07672b80ae44 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:18.071015 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-67faae81-d12a-4410-8fad-07672b80ae44 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:18.207515 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-67faae81-d12a-4410-8fad-07672b80ae44 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:18.214838 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-67faae81-d12a-4410-8fad-07672b80ae44 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.158607 Jul 20 08:28:18.215394 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 201/401] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:18 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:18.599150 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-303dbf7c-fedd-47bd-a369-960f10e96d3b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:18.599809 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-303dbf7c-fedd-47bd-a369-960f10e96d3b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:18.606214 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-303dbf7c-fedd-47bd-a369-960f10e96d3b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:18.606812 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-303dbf7c-fedd-47bd-a369-960f10e96d3b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:18.607669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-303dbf7c-fedd-47bd-a369-960f10e96d3b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:18.608225 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-303dbf7c-fedd-47bd-a369-960f10e96d3b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:18.747811 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-303dbf7c-fedd-47bd-a369-960f10e96d3b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:18.758376 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-303dbf7c-fedd-47bd-a369-960f10e96d3b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1510 microversion: 2.1 time: 0.163296 Jul 20 08:28:18.759495 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 201/402] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:18 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:19.232314 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-123f9e68-73ed-4a8a-ad65-c28f8028043d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:19.232916 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-123f9e68-73ed-4a8a-ad65-c28f8028043d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:19.240280 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-123f9e68-73ed-4a8a-ad65-c28f8028043d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:19.240728 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-123f9e68-73ed-4a8a-ad65-c28f8028043d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:19.241529 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-123f9e68-73ed-4a8a-ad65-c28f8028043d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:19.241967 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-123f9e68-73ed-4a8a-ad65-c28f8028043d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:19.379244 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-123f9e68-73ed-4a8a-ad65-c28f8028043d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:19.386654 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-123f9e68-73ed-4a8a-ad65-c28f8028043d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.158593 Jul 20 08:28:19.387215 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 202/403] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:19 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:19.777781 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b422f8f8-99df-45b1-80c2-b209ac38cc6a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:19.779175 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b422f8f8-99df-45b1-80c2-b209ac38cc6a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:19.786646 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b422f8f8-99df-45b1-80c2-b209ac38cc6a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:19.787432 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b422f8f8-99df-45b1-80c2-b209ac38cc6a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:19.788423 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b422f8f8-99df-45b1-80c2-b209ac38cc6a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:19.788850 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b422f8f8-99df-45b1-80c2-b209ac38cc6a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:19.929839 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b422f8f8-99df-45b1-80c2-b209ac38cc6a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:19.937550 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b422f8f8-99df-45b1-80c2-b209ac38cc6a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1510 microversion: 2.1 time: 0.164190 Jul 20 08:28:19.938174 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 202/404] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:19 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:20.404314 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-edc694eb-7ae6-48c4-9343-61306894debc tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:20.404921 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-edc694eb-7ae6-48c4-9343-61306894debc tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:20.411872 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-edc694eb-7ae6-48c4-9343-61306894debc tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:20.412372 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-edc694eb-7ae6-48c4-9343-61306894debc tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:20.413130 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-edc694eb-7ae6-48c4-9343-61306894debc tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:20.413612 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-edc694eb-7ae6-48c4-9343-61306894debc tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:20.550987 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-edc694eb-7ae6-48c4-9343-61306894debc tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:20.558348 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-edc694eb-7ae6-48c4-9343-61306894debc tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.158201 Jul 20 08:28:20.558935 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 203/405] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:20 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:20.956761 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-778af593-e8d3-4414-8398-9fae06f619da tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:20.957362 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-778af593-e8d3-4414-8398-9fae06f619da tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:20.963491 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-778af593-e8d3-4414-8398-9fae06f619da tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:20.963937 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-778af593-e8d3-4414-8398-9fae06f619da tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:20.964758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-778af593-e8d3-4414-8398-9fae06f619da tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:20.965188 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-778af593-e8d3-4414-8398-9fae06f619da tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:20.967805 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=100 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:28:21.100002 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-778af593-e8d3-4414-8398-9fae06f619da tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:21.107514 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-778af593-e8d3-4414-8398-9fae06f619da tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1510 microversion: 2.1 time: 0.155565 Jul 20 08:28:21.108079 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 203/406] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:20 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:21.575835 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-1444578e-7ac2-4704-ba5c-f1634630a7bb tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:21.576430 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-1444578e-7ac2-4704-ba5c-f1634630a7bb tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:21.582780 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1444578e-7ac2-4704-ba5c-f1634630a7bb tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:21.583219 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1444578e-7ac2-4704-ba5c-f1634630a7bb tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:21.583977 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1444578e-7ac2-4704-ba5c-f1634630a7bb tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:21.584406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1444578e-7ac2-4704-ba5c-f1634630a7bb tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:21.720111 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1444578e-7ac2-4704-ba5c-f1634630a7bb tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:21.727799 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-1444578e-7ac2-4704-ba5c-f1634630a7bb tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.155795 Jul 20 08:28:21.728364 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 204/407] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:21 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:22.124941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-122ac983-06ba-4c91-896f-3ce20d3fdc41 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:22.125545 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-122ac983-06ba-4c91-896f-3ce20d3fdc41 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:22.131863 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-122ac983-06ba-4c91-896f-3ce20d3fdc41 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:22.132311 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-122ac983-06ba-4c91-896f-3ce20d3fdc41 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:22.133077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-122ac983-06ba-4c91-896f-3ce20d3fdc41 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:22.133509 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-122ac983-06ba-4c91-896f-3ce20d3fdc41 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:22.267399 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-122ac983-06ba-4c91-896f-3ce20d3fdc41 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:22.275324 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-122ac983-06ba-4c91-896f-3ce20d3fdc41 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1510 microversion: 2.1 time: 0.154238 Jul 20 08:28:22.275930 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 204/408] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:22 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:22.744316 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9a74d1fc-bff5-4ab5-b42d-fddf9832c3b4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:22.744914 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9a74d1fc-bff5-4ab5-b42d-fddf9832c3b4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:22.752907 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9a74d1fc-bff5-4ab5-b42d-fddf9832c3b4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:22.753350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9a74d1fc-bff5-4ab5-b42d-fddf9832c3b4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:22.754118 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9a74d1fc-bff5-4ab5-b42d-fddf9832c3b4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:22.754545 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9a74d1fc-bff5-4ab5-b42d-fddf9832c3b4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:22.890707 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9a74d1fc-bff5-4ab5-b42d-fddf9832c3b4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:22.899308 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9a74d1fc-bff5-4ab5-b42d-fddf9832c3b4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.158564 Jul 20 08:28:22.899940 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 205/409] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:22 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:23.293289 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-56f4810f-a420-4c47-936d-5d2220b9a9ff tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:23.293894 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-56f4810f-a420-4c47-936d-5d2220b9a9ff tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:23.300006 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-56f4810f-a420-4c47-936d-5d2220b9a9ff tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:23.300447 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-56f4810f-a420-4c47-936d-5d2220b9a9ff tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:23.301199 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-56f4810f-a420-4c47-936d-5d2220b9a9ff tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:23.301629 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-56f4810f-a420-4c47-936d-5d2220b9a9ff tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:23.430570 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-56f4810f-a420-4c47-936d-5d2220b9a9ff tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:23.438056 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-56f4810f-a420-4c47-936d-5d2220b9a9ff tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1510 microversion: 2.1 time: 0.148579 Jul 20 08:28:23.439132 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 205/410] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:23 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:23.917169 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3f38159a-dd9a-4a19-9837-295342e8406d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:23.917776 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3f38159a-dd9a-4a19-9837-295342e8406d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:23.925308 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3f38159a-dd9a-4a19-9837-295342e8406d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:23.925745 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3f38159a-dd9a-4a19-9837-295342e8406d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:23.926524 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3f38159a-dd9a-4a19-9837-295342e8406d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:23.926974 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3f38159a-dd9a-4a19-9837-295342e8406d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:24.070317 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3f38159a-dd9a-4a19-9837-295342e8406d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:24.078789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3f38159a-dd9a-4a19-9837-295342e8406d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.165519 Jul 20 08:28:24.080194 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 206/411] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:23 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:24.456110 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ae23a232-f667-4026-844b-b8753ece0501 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:24.456707 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ae23a232-f667-4026-844b-b8753ece0501 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:24.463588 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ae23a232-f667-4026-844b-b8753ece0501 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:24.464035 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ae23a232-f667-4026-844b-b8753ece0501 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:24.464807 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ae23a232-f667-4026-844b-b8753ece0501 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:24.465238 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ae23a232-f667-4026-844b-b8753ece0501 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:24.603909 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ae23a232-f667-4026-844b-b8753ece0501 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:24.611702 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ae23a232-f667-4026-844b-b8753ece0501 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1510 microversion: 2.1 time: 0.160071 Jul 20 08:28:24.612281 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 206/412] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:24 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:25.097350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-7ca6834d-3598-4b93-b1ca-259fadffa1ce tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:25.097961 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-7ca6834d-3598-4b93-b1ca-259fadffa1ce tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:25.104640 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7ca6834d-3598-4b93-b1ca-259fadffa1ce tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:25.105843 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7ca6834d-3598-4b93-b1ca-259fadffa1ce tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:25.106667 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7ca6834d-3598-4b93-b1ca-259fadffa1ce tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:25.107141 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7ca6834d-3598-4b93-b1ca-259fadffa1ce tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:25.244593 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-7ca6834d-3598-4b93-b1ca-259fadffa1ce tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:25.253193 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-7ca6834d-3598-4b93-b1ca-259fadffa1ce tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.159621 Jul 20 08:28:25.253827 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 207/413] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:25 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:25.630003 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8e014286-f3d4-4302-b4d3-80bdfc88e2ea tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:25.630900 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8e014286-f3d4-4302-b4d3-80bdfc88e2ea tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:25.637160 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8e014286-f3d4-4302-b4d3-80bdfc88e2ea tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:25.637634 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8e014286-f3d4-4302-b4d3-80bdfc88e2ea tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:25.638425 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8e014286-f3d4-4302-b4d3-80bdfc88e2ea tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:25.638879 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8e014286-f3d4-4302-b4d3-80bdfc88e2ea tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:25.775170 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-8e014286-f3d4-4302-b4d3-80bdfc88e2ea tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:25.785961 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8e014286-f3d4-4302-b4d3-80bdfc88e2ea tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1510 microversion: 2.1 time: 0.160611 Jul 20 08:28:25.786784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 207/414] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:25 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:28:26.270880 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-29d4f183-4438-44b1-84ad-10abe8d1e77d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:26.271574 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-29d4f183-4438-44b1-84ad-10abe8d1e77d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:26.278993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-29d4f183-4438-44b1-84ad-10abe8d1e77d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:26.279352 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-29d4f183-4438-44b1-84ad-10abe8d1e77d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:26.280144 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-29d4f183-4438-44b1-84ad-10abe8d1e77d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:26.280578 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-29d4f183-4438-44b1-84ad-10abe8d1e77d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:26.432776 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-29d4f183-4438-44b1-84ad-10abe8d1e77d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:26.440692 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-29d4f183-4438-44b1-84ad-10abe8d1e77d tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.173838 Jul 20 08:28:26.441281 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 208/415] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:26 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:26.803820 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7f612e6e-7e23-4739-9a69-243fba5cd85c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:26.804472 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-7f612e6e-7e23-4739-9a69-243fba5cd85c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:26.810890 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7f612e6e-7e23-4739-9a69-243fba5cd85c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:26.811340 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7f612e6e-7e23-4739-9a69-243fba5cd85c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:26.812127 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7f612e6e-7e23-4739-9a69-243fba5cd85c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:26.812570 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7f612e6e-7e23-4739-9a69-243fba5cd85c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:26.976448 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-7f612e6e-7e23-4739-9a69-243fba5cd85c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:26.984482 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-7f612e6e-7e23-4739-9a69-243fba5cd85c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1510 microversion: 2.1 time: 0.184539 Jul 20 08:28:26.985068 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 208/416] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:26 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:27.457537 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-fa2f0bf5-b2e0-4572-9baa-8db7dc914158 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:27.458119 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-fa2f0bf5-b2e0-4572-9baa-8db7dc914158 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:27.465210 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa2f0bf5-b2e0-4572-9baa-8db7dc914158 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:27.465659 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa2f0bf5-b2e0-4572-9baa-8db7dc914158 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:27.466438 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa2f0bf5-b2e0-4572-9baa-8db7dc914158 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:27.466912 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa2f0bf5-b2e0-4572-9baa-8db7dc914158 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:27.616343 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fa2f0bf5-b2e0-4572-9baa-8db7dc914158 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:27.624723 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-fa2f0bf5-b2e0-4572-9baa-8db7dc914158 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.171744 Jul 20 08:28:27.626061 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 209/417] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:27 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:28.004328 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-439f9228-9636-49cb-8071-c8ac3029c18f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:28.005282 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-439f9228-9636-49cb-8071-c8ac3029c18f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:28.013313 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-439f9228-9636-49cb-8071-c8ac3029c18f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:28.013770 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-439f9228-9636-49cb-8071-c8ac3029c18f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:28.014683 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-439f9228-9636-49cb-8071-c8ac3029c18f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:28.015135 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-439f9228-9636-49cb-8071-c8ac3029c18f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:28.179053 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-439f9228-9636-49cb-8071-c8ac3029c18f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:28.188151 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-439f9228-9636-49cb-8071-c8ac3029c18f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1510 microversion: 2.1 time: 0.189405 Jul 20 08:28:28.198521 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 209/418] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:27 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:28.644667 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f6058ffd-09ab-4996-8c23-9e30c0cb987e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:28.645553 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f6058ffd-09ab-4996-8c23-9e30c0cb987e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:28.651855 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f6058ffd-09ab-4996-8c23-9e30c0cb987e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:28.652297 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f6058ffd-09ab-4996-8c23-9e30c0cb987e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:28.653081 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f6058ffd-09ab-4996-8c23-9e30c0cb987e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:28.653512 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f6058ffd-09ab-4996-8c23-9e30c0cb987e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:28.796468 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f6058ffd-09ab-4996-8c23-9e30c0cb987e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:28.804703 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f6058ffd-09ab-4996-8c23-9e30c0cb987e tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.163841 Jul 20 08:28:28.805279 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 210/419] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:28 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:28:29.206095 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1a3ce71f-a078-4d8f-be91-6b8060d1ed90 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:29.206777 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1a3ce71f-a078-4d8f-be91-6b8060d1ed90 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:29.213058 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1a3ce71f-a078-4d8f-be91-6b8060d1ed90 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:29.213507 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1a3ce71f-a078-4d8f-be91-6b8060d1ed90 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:29.214271 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1a3ce71f-a078-4d8f-be91-6b8060d1ed90 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:29.214737 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1a3ce71f-a078-4d8f-be91-6b8060d1ed90 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:29.352083 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1a3ce71f-a078-4d8f-be91-6b8060d1ed90 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:29.359626 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1a3ce71f-a078-4d8f-be91-6b8060d1ed90 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1516 microversion: 2.1 time: 0.158021 Jul 20 08:28:29.360925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 210/420] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:29 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:29.824613 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-887083c0-f54c-4115-a1a6-56dc81ae5c60 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:29.825370 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-887083c0-f54c-4115-a1a6-56dc81ae5c60 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:29.837163 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-887083c0-f54c-4115-a1a6-56dc81ae5c60 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:29.837163 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-887083c0-f54c-4115-a1a6-56dc81ae5c60 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:29.837163 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-887083c0-f54c-4115-a1a6-56dc81ae5c60 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:29.837163 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-887083c0-f54c-4115-a1a6-56dc81ae5c60 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:29.990005 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-887083c0-f54c-4115-a1a6-56dc81ae5c60 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:29.997694 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-887083c0-f54c-4115-a1a6-56dc81ae5c60 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.177788 Jul 20 08:28:29.998262 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 211/421] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:29 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:31.015360 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-784bdcaa-483b-4fcc-93c6-70212d0af3a4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:31.018217 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-784bdcaa-483b-4fcc-93c6-70212d0af3a4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:31.025739 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-784bdcaa-483b-4fcc-93c6-70212d0af3a4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:31.026015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-784bdcaa-483b-4fcc-93c6-70212d0af3a4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:31.027817 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-784bdcaa-483b-4fcc-93c6-70212d0af3a4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:31.028043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-784bdcaa-483b-4fcc-93c6-70212d0af3a4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:31.406248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-784bdcaa-483b-4fcc-93c6-70212d0af3a4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:31.415813 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-784bdcaa-483b-4fcc-93c6-70212d0af3a4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.404258 Jul 20 08:28:31.426010 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 211/422] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:31 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:31.795319 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c16353f5-49f5-4e21-8681-f16ad328753e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Action: 'create', calling method: .version_select at 0x7fe399feb790>, body: {"keypair": {"name": "tempest-keypair-1257488237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODc8SUmvGRf4m5lbZA4UTGWEFrQCLrL5mxp3u7gWHBO9EgB5XUV756qn5RzgRloiea/VFN0cU6KiTLYwNf/y2ga7RPXvHrCaGkzgiBnmueImBk1KbFgkiX6hbTRMJ9Wjg=="}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:28:31.817753 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-c16353f5-49f5-4e21-8681-f16ad328753e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Getting quotas for project b044b1d7d5474351bd94eb1c90882933. Resources: {'key_pairs'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:28:31.822787 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-c16353f5-49f5-4e21-8681-f16ad328753e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Getting quotas for user bdc9e59d03334b72a8052e0f1112523f and project b044b1d7d5474351bd94eb1c90882933. Resources: {'key_pairs'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:28:31.855215 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c16353f5-49f5-4e21-8681-f16ad328753e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064226 Jul 20 08:28:31.855823 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 212/423] 10.222.0.64 () {60 vars in 1158 bytes} [Wed Jul 20 08:28:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:28:32.433525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3fca64fe-ff0b-4c1a-8f27-282c41dcb434 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:32.434233 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-3fca64fe-ff0b-4c1a-8f27-282c41dcb434 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:32.440436 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3fca64fe-ff0b-4c1a-8f27-282c41dcb434 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:32.440958 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3fca64fe-ff0b-4c1a-8f27-282c41dcb434 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:32.441937 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3fca64fe-ff0b-4c1a-8f27-282c41dcb434 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:32.442373 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3fca64fe-ff0b-4c1a-8f27-282c41dcb434 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:32.693316 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3fca64fe-ff0b-4c1a-8f27-282c41dcb434 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:32.701022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-3fca64fe-ff0b-4c1a-8f27-282c41dcb434 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.271355 Jul 20 08:28:32.711196 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 212/424] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:32 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:33.383026 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d16f077d-a3d9-4d5f-a72a-c05707f36766 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-896046687", "imageRef": "5d6b971e-8afe-4e4a-b054-20cd61970c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c96fa3a3-1d61-4869-813f-bb65cb182cb7"}], "security_groups": [{"name": "tempest-securitygroup--1789512402"}], "key_name": "tempest-keypair-1257488237", "user_data": "}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:28:33.493491 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.network.neutron [None req-d16f077d-a3d9-4d5f-a72a-c05707f36766 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] validate_networks() for [('c96fa3a3-1d61-4869-813f-bb65cb182cb7', None, None, None, None, None)] {{(pid=117829) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:28:33.723711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-036004f0-46a1-4dc4-940c-ce1611183959 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:33.725932 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-036004f0-46a1-4dc4-940c-ce1611183959 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:33.740169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-036004f0-46a1-4dc4-940c-ce1611183959 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:33.744440 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-036004f0-46a1-4dc4-940c-ce1611183959 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:33.745421 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-036004f0-46a1-4dc4-940c-ce1611183959 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:33.746051 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-036004f0-46a1-4dc4-940c-ce1611183959 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:33.950335 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-d16f077d-a3d9-4d5f-a72a-c05707f36766 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Flavor limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:28:33.951489 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-d16f077d-a3d9-4d5f-a72a-c05707f36766 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Image limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:28:33.953186 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-d16f077d-a3d9-4d5f-a72a-c05707f36766 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Flavor pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:28:33.955039 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-d16f077d-a3d9-4d5f-a72a-c05707f36766 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Image pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:28:33.956124 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-d16f077d-a3d9-4d5f-a72a-c05707f36766 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:28:33.971684 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-036004f0-46a1-4dc4-940c-ce1611183959 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:33.972903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d16f077d-a3d9-4d5f-a72a-c05707f36766 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:33.973599 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d16f077d-a3d9-4d5f-a72a-c05707f36766 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:33.974468 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d16f077d-a3d9-4d5f-a72a-c05707f36766 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:33.975169 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d16f077d-a3d9-4d5f-a72a-c05707f36766 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:33.982596 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-036004f0-46a1-4dc4-940c-ce1611183959 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.267055 Jul 20 08:28:33.985262 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 213/425] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:33 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:28:34.006270 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-d16f077d-a3d9-4d5f-a72a-c05707f36766 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Getting quotas for project b044b1d7d5474351bd94eb1c90882933. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:28:34.015867 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-d16f077d-a3d9-4d5f-a72a-c05707f36766 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Getting quotas for user bdc9e59d03334b72a8052e0f1112523f and project b044b1d7d5474351bd94eb1c90882933. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:28:34.020543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-d2cc22cb-959d-4496-ac8c-4ffeb8bdc476 req-a9039bc1-f2e2-448c-a66d-99a8148dd119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f468975-0a18-49f7-a45c-b5973ea35837", "name": "network-vif-plugged", "status": "completed", "tag": "802be1bc-be90-4f26-8cb8-b64bfed9f1f7"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:28:34.034080 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d16f077d-a3d9-4d5f-a72a-c05707f36766 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Going to run 1 instances... {{(pid=117829) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:28:34.036888 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d16f077d-a3d9-4d5f-a72a-c05707f36766 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d6b971e-8afe-4e4a-b054-20cd61970c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117829) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:28:34.037181 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-d2cc22cb-959d-4496-ac8c-4ffeb8bdc476 req-a9039bc1-f2e2-448c-a66d-99a8148dd119 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:34.037913 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-d2cc22cb-959d-4496-ac8c-4ffeb8bdc476 req-a9039bc1-f2e2-448c-a66d-99a8148dd119 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:34.064543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-d2cc22cb-959d-4496-ac8c-4ffeb8bdc476 req-a9039bc1-f2e2-448c-a66d-99a8148dd119 service nova] Creating event network-vif-plugged:802be1bc-be90-4f26-8cb8-b64bfed9f1f7 for instance 0f468975-0a18-49f7-a45c-b5973ea35837 on hv-cinder-82308 Jul 20 08:28:34.078614 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-d2cc22cb-959d-4496-ac8c-4ffeb8bdc476 req-a9039bc1-f2e2-448c-a66d-99a8148dd119 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088380 Jul 20 08:28:34.081282 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 214/426] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:28:34.091674 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d16f077d-a3d9-4d5f-a72a-c05707f36766 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.713674 Jul 20 08:28:34.092480 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 213/427] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Jul 20 08:28:33 2022] POST /compute/v2.1/servers => generated 409 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 08:28:34.103500 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9735804e-cefa-4520-90e7-786ad8f1e49b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:34.104180 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9735804e-cefa-4520-90e7-786ad8f1e49b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:34.163332 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9735804e-cefa-4520-90e7-786ad8f1e49b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:34.171176 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9735804e-cefa-4520-90e7-786ad8f1e49b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1245 microversion: 2.1 time: 0.071773 Jul 20 08:28:34.171736 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 215/428] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:34 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:35.010188 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-dbd13332-7c8c-4053-b07b-296dee06a2cf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:35.012043 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-dbd13332-7c8c-4053-b07b-296dee06a2cf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:35.023640 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-dbd13332-7c8c-4053-b07b-296dee06a2cf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:35.024197 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-dbd13332-7c8c-4053-b07b-296dee06a2cf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:35.025091 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-dbd13332-7c8c-4053-b07b-296dee06a2cf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:35.025435 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-dbd13332-7c8c-4053-b07b-296dee06a2cf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:35.165093 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-dbd13332-7c8c-4053-b07b-296dee06a2cf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:35.172489 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-dbd13332-7c8c-4053-b07b-296dee06a2cf tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.166600 Jul 20 08:28:35.173632 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 214/429] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:35 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:35.188057 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0e7dbb2d-c6a7-459e-ad5b-adc258f00695 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:35.188633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0e7dbb2d-c6a7-459e-ad5b-adc258f00695 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:35.194853 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0e7dbb2d-c6a7-459e-ad5b-adc258f00695 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:35.195294 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0e7dbb2d-c6a7-459e-ad5b-adc258f00695 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:35.196045 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0e7dbb2d-c6a7-459e-ad5b-adc258f00695 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:35.196492 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0e7dbb2d-c6a7-459e-ad5b-adc258f00695 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:35.262789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-0e7dbb2d-c6a7-459e-ad5b-adc258f00695 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:35.270416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0e7dbb2d-c6a7-459e-ad5b-adc258f00695 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1241 microversion: 2.1 time: 0.086168 Jul 20 08:28:35.271014 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 216/430] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:35 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:36.191468 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e850b7ad-074f-46b2-a9a0-c1f9055e3f10 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:36.192115 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e850b7ad-074f-46b2-a9a0-c1f9055e3f10 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:36.199929 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e850b7ad-074f-46b2-a9a0-c1f9055e3f10 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:36.200379 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e850b7ad-074f-46b2-a9a0-c1f9055e3f10 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:36.201154 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e850b7ad-074f-46b2-a9a0-c1f9055e3f10 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:36.201670 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e850b7ad-074f-46b2-a9a0-c1f9055e3f10 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:36.287710 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9b192cde-75c5-4f61-b04c-c3667a531bf7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:36.288295 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9b192cde-75c5-4f61-b04c-c3667a531bf7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:36.294940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9b192cde-75c5-4f61-b04c-c3667a531bf7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:36.295759 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9b192cde-75c5-4f61-b04c-c3667a531bf7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:36.296969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9b192cde-75c5-4f61-b04c-c3667a531bf7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:36.297596 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9b192cde-75c5-4f61-b04c-c3667a531bf7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:36.373618 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9b192cde-75c5-4f61-b04c-c3667a531bf7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:36.378405 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e850b7ad-074f-46b2-a9a0-c1f9055e3f10 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:36.383754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9b192cde-75c5-4f61-b04c-c3667a531bf7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1297 microversion: 2.1 time: 0.099135 Jul 20 08:28:36.384967 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 217/431] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:36 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1297 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:36.387124 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e850b7ad-074f-46b2-a9a0-c1f9055e3f10 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1313 microversion: 2.1 time: 0.200802 Jul 20 08:28:36.387717 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 215/432] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:36 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1313 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:37.402838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ab5ea7b5-9e4f-4985-8c7c-bbcf558a9874 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:37.403462 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ab5ea7b5-9e4f-4985-8c7c-bbcf558a9874 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:37.404457 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-11fc450d-551f-4603-94fd-d89cab4a6953 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:37.405068 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-11fc450d-551f-4603-94fd-d89cab4a6953 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:37.409953 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ab5ea7b5-9e4f-4985-8c7c-bbcf558a9874 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:37.410408 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ab5ea7b5-9e4f-4985-8c7c-bbcf558a9874 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:37.411287 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ab5ea7b5-9e4f-4985-8c7c-bbcf558a9874 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:37.411731 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ab5ea7b5-9e4f-4985-8c7c-bbcf558a9874 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:37.411957 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-11fc450d-551f-4603-94fd-d89cab4a6953 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:37.412405 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-11fc450d-551f-4603-94fd-d89cab4a6953 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:37.413182 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-11fc450d-551f-4603-94fd-d89cab4a6953 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:37.413615 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-11fc450d-551f-4603-94fd-d89cab4a6953 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:37.428627 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:28:37.480198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ab5ea7b5-9e4f-4985-8c7c-bbcf558a9874 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:37.489563 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ab5ea7b5-9e4f-4985-8c7c-bbcf558a9874 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1303 microversion: 2.1 time: 0.090720 Jul 20 08:28:37.490408 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 218/433] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:37 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1303 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:37.691535 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-11fc450d-551f-4603-94fd-d89cab4a6953 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:37.699576 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-11fc450d-551f-4603-94fd-d89cab4a6953 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1496 microversion: 2.1 time: 0.298856 Jul 20 08:28:37.700159 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 216/434] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:37 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1496 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:28:38.356414 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-dd04c64e-095f-4045-8849-5e544124ea14 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:38.357068 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-dd04c64e-095f-4045-8849-5e544124ea14 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:38.359272 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=60 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:28:38.365737 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-dd04c64e-095f-4045-8849-5e544124ea14 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:38.366275 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-dd04c64e-095f-4045-8849-5e544124ea14 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:38.367149 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-dd04c64e-095f-4045-8849-5e544124ea14 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:38.367642 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-dd04c64e-095f-4045-8849-5e544124ea14 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:38.396133 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-dd04c64e-095f-4045-8849-5e544124ea14 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Going to try to terminate instance {{(pid=117828) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:28:38.452981 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:28:38.488029 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-dd04c64e-095f-4045-8849-5e544124ea14 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 204 len: 0 microversion: 2.1 time: 0.134276 Jul 20 08:28:38.488996 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 219/435] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:28:38 2022] DELETE /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:28:38.497578 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-2f173ea5-bb25-4344-a601-5f2e9e3fa4db tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:38.498312 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-2f173ea5-bb25-4344-a601-5f2e9e3fa4db tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:38.506141 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2f173ea5-bb25-4344-a601-5f2e9e3fa4db tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:38.507037 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2f173ea5-bb25-4344-a601-5f2e9e3fa4db tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:38.507890 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2f173ea5-bb25-4344-a601-5f2e9e3fa4db tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:38.508394 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2f173ea5-bb25-4344-a601-5f2e9e3fa4db tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:38.510251 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3a82847b-e189-4ae3-8b66-84481e191154 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:38.510968 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-3a82847b-e189-4ae3-8b66-84481e191154 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:38.518906 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3a82847b-e189-4ae3-8b66-84481e191154 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:38.519372 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3a82847b-e189-4ae3-8b66-84481e191154 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:38.520143 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3a82847b-e189-4ae3-8b66-84481e191154 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:38.520572 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3a82847b-e189-4ae3-8b66-84481e191154 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:38.680202 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3a82847b-e189-4ae3-8b66-84481e191154 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:38.688046 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-3a82847b-e189-4ae3-8b66-84481e191154 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.183508 Jul 20 08:28:38.689251 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 220/436] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:38 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:28:38.739647 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-2f173ea5-bb25-4344-a601-5f2e9e3fa4db tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:38.748644 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-2f173ea5-bb25-4344-a601-5f2e9e3fa4db tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1502 microversion: 2.1 time: 0.254867 Jul 20 08:28:38.749197 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 217/437] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:38 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1502 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:39.128779 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-4ab493a5-cf80-428a-bd9f-3f683560d70e req-9bd9361a-e775-41b1-b773-745fbd82ffc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd05a594-404a-4d6e-ab1a-ee3aacb3970d", "tag": "3cddf9c2-1c8a-40e4-8522-773a3957740b"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:28:39.137899 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-4ab493a5-cf80-428a-bd9f-3f683560d70e req-9bd9361a-e775-41b1-b773-745fbd82ffc5 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:39.138341 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-4ab493a5-cf80-428a-bd9f-3f683560d70e req-9bd9361a-e775-41b1-b773-745fbd82ffc5 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:39.151977 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-4ab493a5-cf80-428a-bd9f-3f683560d70e req-9bd9361a-e775-41b1-b773-745fbd82ffc5 service nova] Creating event network-changed:3cddf9c2-1c8a-40e4-8522-773a3957740b for instance bd05a594-404a-4d6e-ab1a-ee3aacb3970d on hv-cinder-82308 Jul 20 08:28:39.164350 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-4ab493a5-cf80-428a-bd9f-3f683560d70e req-9bd9361a-e775-41b1-b773-745fbd82ffc5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040983 Jul 20 08:28:39.165151 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 221/438] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:28:39.705609 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-88372485-611c-4c4a-a58c-598f134c3f79 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:39.706324 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-88372485-611c-4c4a-a58c-598f134c3f79 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:39.713046 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-88372485-611c-4c4a-a58c-598f134c3f79 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:39.713496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-88372485-611c-4c4a-a58c-598f134c3f79 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:39.714270 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-88372485-611c-4c4a-a58c-598f134c3f79 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:39.714739 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-88372485-611c-4c4a-a58c-598f134c3f79 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:39.767595 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-78d83d28-c4c2-4095-a412-e91ee5e17499 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:39.768425 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-78d83d28-c4c2-4095-a412-e91ee5e17499 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:39.774998 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-78d83d28-c4c2-4095-a412-e91ee5e17499 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:39.775433 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-78d83d28-c4c2-4095-a412-e91ee5e17499 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:39.776235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-78d83d28-c4c2-4095-a412-e91ee5e17499 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:39.776650 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-78d83d28-c4c2-4095-a412-e91ee5e17499 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:39.861774 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-88372485-611c-4c4a-a58c-598f134c3f79 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:39.869309 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-88372485-611c-4c4a-a58c-598f134c3f79 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.167759 Jul 20 08:28:39.870075 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 218/439] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:39 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:39.918726 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-78d83d28-c4c2-4095-a412-e91ee5e17499 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:39.927364 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-78d83d28-c4c2-4095-a412-e91ee5e17499 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1502 microversion: 2.1 time: 0.164131 Jul 20 08:28:39.927982 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 222/440] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:39 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:28:40.887651 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5ed2ebb3-dfff-40b1-abff-f336907910b2 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:40.889057 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5ed2ebb3-dfff-40b1-abff-f336907910b2 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:40.891914 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:28:40.897280 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5ed2ebb3-dfff-40b1-abff-f336907910b2 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:40.897756 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5ed2ebb3-dfff-40b1-abff-f336907910b2 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:40.898571 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5ed2ebb3-dfff-40b1-abff-f336907910b2 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:40.899092 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5ed2ebb3-dfff-40b1-abff-f336907910b2 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:40.944676 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5e467dc7-4b31-40d3-a6d4-95852c897d4c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:40.945262 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-5e467dc7-4b31-40d3-a6d4-95852c897d4c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:40.951206 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5e467dc7-4b31-40d3-a6d4-95852c897d4c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:40.951636 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5e467dc7-4b31-40d3-a6d4-95852c897d4c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:40.952391 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5e467dc7-4b31-40d3-a6d4-95852c897d4c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:40.952890 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5e467dc7-4b31-40d3-a6d4-95852c897d4c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:41.089997 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5e467dc7-4b31-40d3-a6d4-95852c897d4c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:41.096975 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5ed2ebb3-dfff-40b1-abff-f336907910b2 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:41.098278 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-5e467dc7-4b31-40d3-a6d4-95852c897d4c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1502 microversion: 2.1 time: 0.157480 Jul 20 08:28:41.099085 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 223/441] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:40 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:28:41.104839 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5ed2ebb3-dfff-40b1-abff-f336907910b2 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.221547 Jul 20 08:28:41.105726 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 219/442] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:40 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:28:42.117043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ad76c7aa-bde6-4fe4-acb3-2318606c0b07 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:42.117743 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ad76c7aa-bde6-4fe4-acb3-2318606c0b07 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:42.121336 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-45dcc218-6d39-4822-b0dc-cf5f4ebcadd9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:42.121943 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-45dcc218-6d39-4822-b0dc-cf5f4ebcadd9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:42.123863 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ad76c7aa-bde6-4fe4-acb3-2318606c0b07 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:42.124315 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ad76c7aa-bde6-4fe4-acb3-2318606c0b07 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:42.125090 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ad76c7aa-bde6-4fe4-acb3-2318606c0b07 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:42.125527 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ad76c7aa-bde6-4fe4-acb3-2318606c0b07 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:42.128832 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-45dcc218-6d39-4822-b0dc-cf5f4ebcadd9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:42.129282 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-45dcc218-6d39-4822-b0dc-cf5f4ebcadd9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:42.130058 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-45dcc218-6d39-4822-b0dc-cf5f4ebcadd9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:42.130495 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-45dcc218-6d39-4822-b0dc-cf5f4ebcadd9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:42.275264 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ad76c7aa-bde6-4fe4-acb3-2318606c0b07 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:42.279334 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-45dcc218-6d39-4822-b0dc-cf5f4ebcadd9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:42.284321 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ad76c7aa-bde6-4fe4-acb3-2318606c0b07 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1502 microversion: 2.1 time: 0.171066 Jul 20 08:28:42.285131 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 224/443] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:42 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1502 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:42.296337 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-45dcc218-6d39-4822-b0dc-cf5f4ebcadd9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.178760 Jul 20 08:28:42.296983 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 220/444] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:42 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:28:43.303245 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-490c9506-371e-45fa-96df-87d23d5a9151 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:43.304136 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-490c9506-371e-45fa-96df-87d23d5a9151 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:43.310561 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-490c9506-371e-45fa-96df-87d23d5a9151 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:43.311040 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-490c9506-371e-45fa-96df-87d23d5a9151 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:43.311811 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-490c9506-371e-45fa-96df-87d23d5a9151 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:43.312244 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-490c9506-371e-45fa-96df-87d23d5a9151 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:43.314479 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-fa9802a6-56ad-4eff-9131-4a9715616084 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:43.315163 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-fa9802a6-56ad-4eff-9131-4a9715616084 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:43.321577 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa9802a6-56ad-4eff-9131-4a9715616084 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:43.322046 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa9802a6-56ad-4eff-9131-4a9715616084 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:43.322839 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa9802a6-56ad-4eff-9131-4a9715616084 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:43.323285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa9802a6-56ad-4eff-9131-4a9715616084 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:43.460516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-490c9506-371e-45fa-96df-87d23d5a9151 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:43.471478 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fa9802a6-56ad-4eff-9131-4a9715616084 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:43.471831 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-490c9506-371e-45fa-96df-87d23d5a9151 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1502 microversion: 2.1 time: 0.172291 Jul 20 08:28:43.480248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 225/445] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:43 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1502 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:43.486517 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-fa9802a6-56ad-4eff-9131-4a9715616084 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.176372 Jul 20 08:28:43.487145 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 221/446] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:43 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:44.490008 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b42c9251-9b56-432d-8b91-bd14fa05f904 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:44.490649 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b42c9251-9b56-432d-8b91-bd14fa05f904 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:44.492591 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=2 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:28:44.498009 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b42c9251-9b56-432d-8b91-bd14fa05f904 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:44.498458 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b42c9251-9b56-432d-8b91-bd14fa05f904 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:44.499253 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b42c9251-9b56-432d-8b91-bd14fa05f904 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:44.499691 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b42c9251-9b56-432d-8b91-bd14fa05f904 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:44.504133 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-471d7d8b-5955-4ff1-9dd3-acbbe5ab8649 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:44.504744 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-471d7d8b-5955-4ff1-9dd3-acbbe5ab8649 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:44.506711 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=2 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:28:44.507538 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=10 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:28:44.514430 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-471d7d8b-5955-4ff1-9dd3-acbbe5ab8649 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:44.514911 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-471d7d8b-5955-4ff1-9dd3-acbbe5ab8649 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:44.515689 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-471d7d8b-5955-4ff1-9dd3-acbbe5ab8649 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:44.516117 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-471d7d8b-5955-4ff1-9dd3-acbbe5ab8649 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:44.655529 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b42c9251-9b56-432d-8b91-bd14fa05f904 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:44.666754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b42c9251-9b56-432d-8b91-bd14fa05f904 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1502 microversion: 2.1 time: 0.179258 Jul 20 08:28:44.667780 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-471d7d8b-5955-4ff1-9dd3-acbbe5ab8649 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:44.668223 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 226/447] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:44 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:44.677744 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-471d7d8b-5955-4ff1-9dd3-acbbe5ab8649 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.178226 Jul 20 08:28:44.678367 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 222/448] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:44 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:28:45.686222 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-09e899bf-446d-4607-a8b0-2341e1f3f06c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:45.686858 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-09e899bf-446d-4607-a8b0-2341e1f3f06c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:45.693821 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-09e899bf-446d-4607-a8b0-2341e1f3f06c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:45.694289 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-09e899bf-446d-4607-a8b0-2341e1f3f06c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:45.695058 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-09e899bf-446d-4607-a8b0-2341e1f3f06c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:45.695367 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-68195e0a-3664-447c-b1c8-a67913a5aade tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:45.695802 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-09e899bf-446d-4607-a8b0-2341e1f3f06c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:45.695967 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-68195e0a-3664-447c-b1c8-a67913a5aade tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:45.702926 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-68195e0a-3664-447c-b1c8-a67913a5aade tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:45.703638 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-68195e0a-3664-447c-b1c8-a67913a5aade tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:45.705044 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-68195e0a-3664-447c-b1c8-a67913a5aade tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:45.705483 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-68195e0a-3664-447c-b1c8-a67913a5aade tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:45.857101 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-09e899bf-446d-4607-a8b0-2341e1f3f06c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:45.868777 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-09e899bf-446d-4607-a8b0-2341e1f3f06c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1502 microversion: 2.1 time: 0.185764 Jul 20 08:28:45.871923 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 227/449] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:45 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1502 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:46.098639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-68195e0a-3664-447c-b1c8-a67913a5aade tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:46.106531 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-68195e0a-3664-447c-b1c8-a67913a5aade tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.415046 Jul 20 08:28:46.107148 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 223/450] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:45 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:46.776389 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-53eae6f3-29c4-4de3-b823-a1c663a42eca req-d13059bb-b239-4291-9592-4c66bf35c220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f468975-0a18-49f7-a45c-b5973ea35837", "name": "network-vif-unplugged", "status": "completed", "tag": "802be1bc-be90-4f26-8cb8-b64bfed9f1f7"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:28:46.785175 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-53eae6f3-29c4-4de3-b823-a1c663a42eca req-d13059bb-b239-4291-9592-4c66bf35c220 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:46.785703 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-53eae6f3-29c4-4de3-b823-a1c663a42eca req-d13059bb-b239-4291-9592-4c66bf35c220 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:46.799010 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-53eae6f3-29c4-4de3-b823-a1c663a42eca req-d13059bb-b239-4291-9592-4c66bf35c220 service nova] Creating event network-vif-unplugged:802be1bc-be90-4f26-8cb8-b64bfed9f1f7 for instance 0f468975-0a18-49f7-a45c-b5973ea35837 on hv-cinder-82308 Jul 20 08:28:46.804497 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-53eae6f3-29c4-4de3-b823-a1c663a42eca req-d13059bb-b239-4291-9592-4c66bf35c220 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031814 Jul 20 08:28:46.805252 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 228/451] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:28:46.895055 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-06b3ee97-79a4-4bf6-953f-9388dd8aef72 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:46.895715 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-06b3ee97-79a4-4bf6-953f-9388dd8aef72 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:46.902085 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-06b3ee97-79a4-4bf6-953f-9388dd8aef72 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:46.902570 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-06b3ee97-79a4-4bf6-953f-9388dd8aef72 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:46.903344 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-06b3ee97-79a4-4bf6-953f-9388dd8aef72 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:46.903860 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-06b3ee97-79a4-4bf6-953f-9388dd8aef72 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:47.038328 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-06b3ee97-79a4-4bf6-953f-9388dd8aef72 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:47.046138 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-06b3ee97-79a4-4bf6-953f-9388dd8aef72 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1502 microversion: 2.1 time: 0.155125 Jul 20 08:28:47.046732 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 224/452] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:46 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:47.124235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3f3d5c12-cab3-42a0-b657-252ab0e0f53d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:47.124921 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-3f3d5c12-cab3-42a0-b657-252ab0e0f53d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:47.131530 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3f3d5c12-cab3-42a0-b657-252ab0e0f53d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:47.131971 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3f3d5c12-cab3-42a0-b657-252ab0e0f53d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:47.132727 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3f3d5c12-cab3-42a0-b657-252ab0e0f53d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:47.133159 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3f3d5c12-cab3-42a0-b657-252ab0e0f53d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:47.264299 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3f3d5c12-cab3-42a0-b657-252ab0e0f53d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:47.272175 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-3f3d5c12-cab3-42a0-b657-252ab0e0f53d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.152108 Jul 20 08:28:47.272730 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 229/453] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:47 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:48.064374 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-cad31956-f12f-4bae-a555-3f7348c94eef tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:48.065021 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-cad31956-f12f-4bae-a555-3f7348c94eef tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:48.071616 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cad31956-f12f-4bae-a555-3f7348c94eef tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:48.072065 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cad31956-f12f-4bae-a555-3f7348c94eef tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:48.072840 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cad31956-f12f-4bae-a555-3f7348c94eef tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:48.073341 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cad31956-f12f-4bae-a555-3f7348c94eef tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:48.208852 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-cad31956-f12f-4bae-a555-3f7348c94eef tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:48.216238 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-cad31956-f12f-4bae-a555-3f7348c94eef tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1502 microversion: 2.1 time: 0.156521 Jul 20 08:28:48.216800 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 225/454] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:48 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:48.289009 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-6a4dc48e-7dc0-4da4-8dce-16771ed5e256 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:48.289643 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-6a4dc48e-7dc0-4da4-8dce-16771ed5e256 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:48.295748 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6a4dc48e-7dc0-4da4-8dce-16771ed5e256 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:48.296195 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6a4dc48e-7dc0-4da4-8dce-16771ed5e256 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:48.296955 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6a4dc48e-7dc0-4da4-8dce-16771ed5e256 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:48.297388 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6a4dc48e-7dc0-4da4-8dce-16771ed5e256 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:48.431115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-6a4dc48e-7dc0-4da4-8dce-16771ed5e256 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:48.438700 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-6a4dc48e-7dc0-4da4-8dce-16771ed5e256 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.153442 Jul 20 08:28:48.439271 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 230/455] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:48 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:49.233330 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ac9b1b67-ce0c-48d9-8360-91905d9a7768 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:49.233891 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ac9b1b67-ce0c-48d9-8360-91905d9a7768 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:49.241029 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ac9b1b67-ce0c-48d9-8360-91905d9a7768 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:49.241474 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ac9b1b67-ce0c-48d9-8360-91905d9a7768 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:49.242270 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ac9b1b67-ce0c-48d9-8360-91905d9a7768 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:49.242734 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ac9b1b67-ce0c-48d9-8360-91905d9a7768 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:49.379291 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ac9b1b67-ce0c-48d9-8360-91905d9a7768 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:49.386735 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ac9b1b67-ce0c-48d9-8360-91905d9a7768 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1502 microversion: 2.1 time: 0.157327 Jul 20 08:28:49.387304 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 226/456] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:49 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1502 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:49.456292 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0302ad96-5034-4703-acd2-5defea36d53b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:49.456892 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0302ad96-5034-4703-acd2-5defea36d53b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:49.462936 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0302ad96-5034-4703-acd2-5defea36d53b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:49.463509 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0302ad96-5034-4703-acd2-5defea36d53b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:49.464165 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0302ad96-5034-4703-acd2-5defea36d53b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:49.464575 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0302ad96-5034-4703-acd2-5defea36d53b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:49.605421 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-0302ad96-5034-4703-acd2-5defea36d53b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:49.614217 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0302ad96-5034-4703-acd2-5defea36d53b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.161971 Jul 20 08:28:49.615106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 231/457] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:49 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:50.403723 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5ad1eda4-a750-4b37-a493-0e76e178d7a4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:50.404323 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5ad1eda4-a750-4b37-a493-0e76e178d7a4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:50.411173 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5ad1eda4-a750-4b37-a493-0e76e178d7a4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:50.411617 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5ad1eda4-a750-4b37-a493-0e76e178d7a4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:50.412383 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5ad1eda4-a750-4b37-a493-0e76e178d7a4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:50.412816 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5ad1eda4-a750-4b37-a493-0e76e178d7a4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:50.546627 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5ad1eda4-a750-4b37-a493-0e76e178d7a4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:50.555162 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5ad1eda4-a750-4b37-a493-0e76e178d7a4 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1502 microversion: 2.1 time: 0.155167 Jul 20 08:28:50.555662 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 227/458] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:50 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:50.633441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-002f7467-f7a5-484d-bea0-eadb359fac04 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:50.634044 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-002f7467-f7a5-484d-bea0-eadb359fac04 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:50.640063 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-002f7467-f7a5-484d-bea0-eadb359fac04 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:50.640509 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-002f7467-f7a5-484d-bea0-eadb359fac04 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:50.641276 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-002f7467-f7a5-484d-bea0-eadb359fac04 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:50.641708 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-002f7467-f7a5-484d-bea0-eadb359fac04 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:50.776219 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-002f7467-f7a5-484d-bea0-eadb359fac04 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:50.784001 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-002f7467-f7a5-484d-bea0-eadb359fac04 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.154498 Jul 20 08:28:50.784552 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 232/459] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:50 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:51.573046 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5871b9fd-057a-48c6-ae99-61888ebbfdb5 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:51.573681 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5871b9fd-057a-48c6-ae99-61888ebbfdb5 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:51.579909 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5871b9fd-057a-48c6-ae99-61888ebbfdb5 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:51.580185 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5871b9fd-057a-48c6-ae99-61888ebbfdb5 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:51.580954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5871b9fd-057a-48c6-ae99-61888ebbfdb5 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:51.581388 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5871b9fd-057a-48c6-ae99-61888ebbfdb5 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:51.716428 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5871b9fd-057a-48c6-ae99-61888ebbfdb5 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:51.724332 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5871b9fd-057a-48c6-ae99-61888ebbfdb5 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1502 microversion: 2.1 time: 0.155167 Jul 20 08:28:51.724912 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 228/460] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:51 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:51.801986 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-09d0e715-f539-445c-aa49-dac05d8337eb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:51.802601 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-09d0e715-f539-445c-aa49-dac05d8337eb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:51.808617 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-09d0e715-f539-445c-aa49-dac05d8337eb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:51.809065 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-09d0e715-f539-445c-aa49-dac05d8337eb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:51.809821 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-09d0e715-f539-445c-aa49-dac05d8337eb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:51.810254 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-09d0e715-f539-445c-aa49-dac05d8337eb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:51.941086 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-09d0e715-f539-445c-aa49-dac05d8337eb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:51.949053 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-09d0e715-f539-445c-aa49-dac05d8337eb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.151853 Jul 20 08:28:51.949709 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 233/461] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:51 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:52.741983 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9b7b2cff-fd64-47a8-be6b-a1b62e3117be tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:52.742632 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9b7b2cff-fd64-47a8-be6b-a1b62e3117be tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:52.749239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9b7b2cff-fd64-47a8-be6b-a1b62e3117be tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:52.749685 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9b7b2cff-fd64-47a8-be6b-a1b62e3117be tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:52.750446 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9b7b2cff-fd64-47a8-be6b-a1b62e3117be tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:52.751498 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9b7b2cff-fd64-47a8-be6b-a1b62e3117be tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:52.884370 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9b7b2cff-fd64-47a8-be6b-a1b62e3117be tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:52.893155 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9b7b2cff-fd64-47a8-be6b-a1b62e3117be tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1502 microversion: 2.1 time: 0.155078 Jul 20 08:28:52.893710 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 229/462] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:52 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:52.966423 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1965af2f-4a27-4534-9349-bb012fc77f35 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:52.967053 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1965af2f-4a27-4534-9349-bb012fc77f35 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:52.973173 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1965af2f-4a27-4534-9349-bb012fc77f35 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:52.973622 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1965af2f-4a27-4534-9349-bb012fc77f35 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:52.974411 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1965af2f-4a27-4534-9349-bb012fc77f35 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:52.974878 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1965af2f-4a27-4534-9349-bb012fc77f35 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:53.111764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1965af2f-4a27-4534-9349-bb012fc77f35 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:53.119566 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1965af2f-4a27-4534-9349-bb012fc77f35 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.157169 Jul 20 08:28:53.120183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 234/463] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:52 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:53.910541 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d4b41f4d-3361-4288-9c00-0d6e56da2d0b tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:53.911125 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d4b41f4d-3361-4288-9c00-0d6e56da2d0b tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:53.918387 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d4b41f4d-3361-4288-9c00-0d6e56da2d0b tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:53.918852 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d4b41f4d-3361-4288-9c00-0d6e56da2d0b tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:53.919609 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d4b41f4d-3361-4288-9c00-0d6e56da2d0b tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:53.920041 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d4b41f4d-3361-4288-9c00-0d6e56da2d0b tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:54.052053 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d4b41f4d-3361-4288-9c00-0d6e56da2d0b tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:54.059428 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d4b41f4d-3361-4288-9c00-0d6e56da2d0b tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1502 microversion: 2.1 time: 0.153356 Jul 20 08:28:54.059989 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 230/464] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:53 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:54.136684 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5a053fd2-bbe4-4b06-98ca-db2cc757062e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:54.137306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-5a053fd2-bbe4-4b06-98ca-db2cc757062e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:54.144920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5a053fd2-bbe4-4b06-98ca-db2cc757062e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:54.145368 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5a053fd2-bbe4-4b06-98ca-db2cc757062e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:54.146154 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5a053fd2-bbe4-4b06-98ca-db2cc757062e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:54.146598 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5a053fd2-bbe4-4b06-98ca-db2cc757062e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:54.288397 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5a053fd2-bbe4-4b06-98ca-db2cc757062e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:54.295845 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-5a053fd2-bbe4-4b06-98ca-db2cc757062e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.163025 Jul 20 08:28:54.296407 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 235/465] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:54 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:55.076546 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-b54ac649-d570-41de-85df-d7c58d1272a3 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:55.077255 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-b54ac649-d570-41de-85df-d7c58d1272a3 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:55.085228 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b54ac649-d570-41de-85df-d7c58d1272a3 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:55.085836 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b54ac649-d570-41de-85df-d7c58d1272a3 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:55.086718 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b54ac649-d570-41de-85df-d7c58d1272a3 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:55.087151 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b54ac649-d570-41de-85df-d7c58d1272a3 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:55.295660 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b54ac649-d570-41de-85df-d7c58d1272a3 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:55.304593 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-b54ac649-d570-41de-85df-d7c58d1272a3 tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1502 microversion: 2.1 time: 0.231949 Jul 20 08:28:55.306678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 231/466] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:55 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1502 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:55.312468 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-351c557e-2acb-4ae1-8c2a-4d794759b71d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:55.313876 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-351c557e-2acb-4ae1-8c2a-4d794759b71d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:55.320445 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-351c557e-2acb-4ae1-8c2a-4d794759b71d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:55.320893 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-351c557e-2acb-4ae1-8c2a-4d794759b71d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:55.321860 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-351c557e-2acb-4ae1-8c2a-4d794759b71d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:55.322294 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-351c557e-2acb-4ae1-8c2a-4d794759b71d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:55.461526 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-351c557e-2acb-4ae1-8c2a-4d794759b71d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:55.474498 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-351c557e-2acb-4ae1-8c2a-4d794759b71d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.166371 Jul 20 08:28:55.475291 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 236/467] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:55 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:55.539479 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-6ccd194e-7bfa-49c7-b781-0c2e544c2c07 req-82d3f656-3761-40e1-9122-e64834ed7274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f468975-0a18-49f7-a45c-b5973ea35837", "name": "network-vif-deleted", "tag": "802be1bc-be90-4f26-8cb8-b64bfed9f1f7"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:28:55.548734 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-6ccd194e-7bfa-49c7-b781-0c2e544c2c07 req-82d3f656-3761-40e1-9122-e64834ed7274 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:55.549172 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-6ccd194e-7bfa-49c7-b781-0c2e544c2c07 req-82d3f656-3761-40e1-9122-e64834ed7274 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:55.560555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-6ccd194e-7bfa-49c7-b781-0c2e544c2c07 req-82d3f656-3761-40e1-9122-e64834ed7274 service nova] Creating event network-vif-deleted:802be1bc-be90-4f26-8cb8-b64bfed9f1f7 for instance 0f468975-0a18-49f7-a45c-b5973ea35837 on hv-cinder-82308 Jul 20 08:28:55.566102 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-6ccd194e-7bfa-49c7-b781-0c2e544c2c07 req-82d3f656-3761-40e1-9122-e64834ed7274 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030839 Jul 20 08:28:55.566719 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 232/468] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:28:56.325174 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9696442a-050c-4d89-975d-b3ff80e94d5f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:56.325783 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9696442a-050c-4d89-975d-b3ff80e94d5f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:56.332376 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9696442a-050c-4d89-975d-b3ff80e94d5f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:56.332825 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9696442a-050c-4d89-975d-b3ff80e94d5f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:56.333593 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9696442a-050c-4d89-975d-b3ff80e94d5f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:56.334029 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9696442a-050c-4d89-975d-b3ff80e94d5f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:56.365959 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9696442a-050c-4d89-975d-b3ff80e94d5f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:56.367431 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9696442a-050c-4d89-975d-b3ff80e94d5f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:56.367431 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.objects.instance [None req-9696442a-050c-4d89-975d-b3ff80e94d5f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lazy-loading 'fault' on Instance uuid 0f468975-0a18-49f7-a45c-b5973ea35837 {{(pid=117828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:28:56.369790 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:28:56.415446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9696442a-050c-4d89-975d-b3ff80e94d5f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd88c5f05aab0458d8dc0a285bce33f28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02622d333fa24a0bbd1ef6f59276ba77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:56.423850 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9696442a-050c-4d89-975d-b3ff80e94d5f tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 200 len: 1303 microversion: 2.1 time: 0.102581 Jul 20 08:28:56.424421 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 237/469] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:56 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:56.492167 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4daffcd4-e658-4236-b669-eb2b598d0a62 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:56.492858 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4daffcd4-e658-4236-b669-eb2b598d0a62 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:56.506929 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4daffcd4-e658-4236-b669-eb2b598d0a62 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:56.507527 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4daffcd4-e658-4236-b669-eb2b598d0a62 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:56.508451 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4daffcd4-e658-4236-b669-eb2b598d0a62 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:56.508897 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4daffcd4-e658-4236-b669-eb2b598d0a62 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:56.574629 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-566cf4ef-0040-40fc-98d9-b450c06f4d97 req-f986150e-1ef1-4192-bfcd-5ebfc44b2f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd05a594-404a-4d6e-ab1a-ee3aacb3970d", "name": "network-vif-plugged", "status": "completed", "tag": "3cddf9c2-1c8a-40e4-8522-773a3957740b"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:28:56.589001 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-566cf4ef-0040-40fc-98d9-b450c06f4d97 req-f986150e-1ef1-4192-bfcd-5ebfc44b2f5e service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:56.589673 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-566cf4ef-0040-40fc-98d9-b450c06f4d97 req-f986150e-1ef1-4192-bfcd-5ebfc44b2f5e service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:56.615647 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-566cf4ef-0040-40fc-98d9-b450c06f4d97 req-f986150e-1ef1-4192-bfcd-5ebfc44b2f5e service nova] Creating event network-vif-plugged:3cddf9c2-1c8a-40e4-8522-773a3957740b for instance bd05a594-404a-4d6e-ab1a-ee3aacb3970d on hv-cinder-82308 Jul 20 08:28:56.620829 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-566cf4ef-0040-40fc-98d9-b450c06f4d97 req-f986150e-1ef1-4192-bfcd-5ebfc44b2f5e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056413 Jul 20 08:28:56.621507 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 238/470] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:28:56.659115 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4daffcd4-e658-4236-b669-eb2b598d0a62 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:56.661624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:28:56.670359 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4daffcd4-e658-4236-b669-eb2b598d0a62 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.182583 Jul 20 08:28:56.671160 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 233/471] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:56 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:57.442540 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-77f4434d-1f36-4b02-b5bb-d9cc562ab75c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:57.443377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-77f4434d-1f36-4b02-b5bb-d9cc562ab75c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] [instance: 0f468975-0a18-49f7-a45c-b5973ea35837] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:57.449654 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-77f4434d-1f36-4b02-b5bb-d9cc562ab75c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:57.450101 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-77f4434d-1f36-4b02-b5bb-d9cc562ab75c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:57.450900 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-77f4434d-1f36-4b02-b5bb-d9cc562ab75c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:57.451335 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-77f4434d-1f36-4b02-b5bb-d9cc562ab75c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:57.464397 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-77f4434d-1f36-4b02-b5bb-d9cc562ab75c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] HTTP exception thrown: Instance 0f468975-0a18-49f7-a45c-b5973ea35837 could not be found. Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-77f4434d-1f36-4b02-b5bb-d9cc562ab75c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Request method failure captured: Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 HTTP/1.1 Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17xuvIkbC4r7pu_2TlUAx6P2onBPaVX_ERbKhDn2ykBSlpnP7Abr_wr006iGNd6dhOsCIczuWK0fO3hKIk0L65tSOvRvvGL53DtRPQ6zFuNCAyPSNn4skbsQjjs7UzgOWIS8egAGrbTZFtUtyg7Kbz8Z2IEA2hfrTjk89m-aK5irXdw Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: 02622d333fa24a0bbd1ef6f59276ba77 Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-VolumesActionsTest-1676923366 Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:28:57.466036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:28:57.467633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/02622d333fa24a0bbd1ef6f59276ba77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/02622d333fa24a0bbd1ef6f59276ba77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_02622d333fa24a0bbd1ef6f59276ba77", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/02622d333fa24a0bbd1ef6f59276ba77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:28:57.467633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-VolumesActionsTest-1676923366 Jul 20 08:28:57.467633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: 02622d333fa24a0bbd1ef6f59276ba77 Jul 20 08:28:57.467633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-VolumesActionsTest-1676923366 Jul 20 08:28:57.467633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-VolumesActionsTest-1676923366-project Jul 20 08:28:57.467633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:28:57.467633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:28:57.467633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: d88c5f05aab0458d8dc0a285bce33f28 Jul 20 08:28:57.467633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-VolumesActionsTest-1676923366-project Jul 20 08:28:57.467633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:28:57.467633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance 0f468975-0a18-49f7-a45c-b5973ea35837 could not be found. Jul 20 08:28:57.467633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': '0f468975-0a18-49f7-a45c-b5973ea35837'} Jul 20 08:28:57.468525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:28:57.468525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:28:57.468525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:28:57.468525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:28:57.468525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:28:57.468525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:28:57.468525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:28:57.468525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:28:57.468525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:28:57.468525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:28:57.468525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f468975-0a18-49f7-a45c-b5973ea35837 could not be found. Jul 20 08:28:57.468525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:28:57.468525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:28:57.468525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:28:57.468525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:28:57.468525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:28:57.468525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:28:57.468525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:28:57.468525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:28:57.468525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:28:57.470169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:28:57.470169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:28:57.470169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:28:57.470169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:28:57.470169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:28:57.470169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:28:57.470169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:28:57.470169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f468975-0a18-49f7-a45c-b5973ea35837 could not be found. Jul 20 08:28:57.470169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:28:57.470169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:28:57.470169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:28:57.470169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:28:57.470169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:28:57.470169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:28:57.470169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:28:57.470169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:28:57.470169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f468975-0a18-49f7-a45c-b5973ea35837 could not be found. Jul 20 08:28:57.470169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:28:57.471637 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-77f4434d-1f36-4b02-b5bb-d9cc562ab75c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] Returning 404 to user: Instance 0f468975-0a18-49f7-a45c-b5973ea35837 could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:28:57.471637 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-77f4434d-1f36-4b02-b5bb-d9cc562ab75c tempest-VolumesActionsTest-1676923366 tempest-VolumesActionsTest-1676923366-project] 10.222.0.64 "GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837" status: 404 len: 111 microversion: 2.1 time: 0.029832 Jul 20 08:28:57.471637 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 239/472] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:57 2022] GET /compute/v2.1/servers/0f468975-0a18-49f7-a45c-b5973ea35837 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:28:57.688614 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4f6e3cf2-7b2e-486f-94b1-db484adce816 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:57.689354 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4f6e3cf2-7b2e-486f-94b1-db484adce816 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:57.695997 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4f6e3cf2-7b2e-486f-94b1-db484adce816 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:57.696543 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4f6e3cf2-7b2e-486f-94b1-db484adce816 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:57.697579 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4f6e3cf2-7b2e-486f-94b1-db484adce816 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:57.697968 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4f6e3cf2-7b2e-486f-94b1-db484adce816 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:57.834287 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4f6e3cf2-7b2e-486f-94b1-db484adce816 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:57.842465 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4f6e3cf2-7b2e-486f-94b1-db484adce816 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.157768 Jul 20 08:28:57.843301 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 234/473] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:57 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:28:58.859797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1be5822d-5910-4e28-8ec9-2dd8b43d3592 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:28:58.861181 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1be5822d-5910-4e28-8ec9-2dd8b43d3592 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:28:58.867220 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1be5822d-5910-4e28-8ec9-2dd8b43d3592 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:58.867658 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1be5822d-5910-4e28-8ec9-2dd8b43d3592 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:58.868414 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1be5822d-5910-4e28-8ec9-2dd8b43d3592 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:28:58.868845 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1be5822d-5910-4e28-8ec9-2dd8b43d3592 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:28:58.998477 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1be5822d-5910-4e28-8ec9-2dd8b43d3592 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:28:59.006823 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1be5822d-5910-4e28-8ec9-2dd8b43d3592 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.150729 Jul 20 08:28:59.007387 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 240/474] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:28:58 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:29:00.023544 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-44b93884-841e-4938-9737-36a6ef7666bc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:29:00.024563 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-44b93884-841e-4938-9737-36a6ef7666bc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:29:00.030669 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-44b93884-841e-4938-9737-36a6ef7666bc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:29:00.031142 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-44b93884-841e-4938-9737-36a6ef7666bc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:29:00.031908 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-44b93884-841e-4938-9737-36a6ef7666bc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:29:00.032339 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-44b93884-841e-4938-9737-36a6ef7666bc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:29:00.165066 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-44b93884-841e-4938-9737-36a6ef7666bc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:29:00.173093 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-44b93884-841e-4938-9737-36a6ef7666bc tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.152859 Jul 20 08:29:00.173686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 235/475] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:29:00 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:29:01.190751 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-4c24c1eb-a841-4609-85e0-432dfb3bdb18 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:29:01.191347 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-4c24c1eb-a841-4609-85e0-432dfb3bdb18 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:29:01.197386 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4c24c1eb-a841-4609-85e0-432dfb3bdb18 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:29:01.197824 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4c24c1eb-a841-4609-85e0-432dfb3bdb18 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:29:01.198602 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4c24c1eb-a841-4609-85e0-432dfb3bdb18 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:29:01.199018 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4c24c1eb-a841-4609-85e0-432dfb3bdb18 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:29:01.327786 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-4c24c1eb-a841-4609-85e0-432dfb3bdb18 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:29:01.335216 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-4c24c1eb-a841-4609-85e0-432dfb3bdb18 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.149076 Jul 20 08:29:01.335769 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 241/476] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:29:01 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:29:02.351739 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4b6a7138-b38d-44a9-a001-33316211850f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:29:02.352337 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4b6a7138-b38d-44a9-a001-33316211850f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:29:02.359210 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4b6a7138-b38d-44a9-a001-33316211850f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:29:02.359686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4b6a7138-b38d-44a9-a001-33316211850f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:29:02.360564 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4b6a7138-b38d-44a9-a001-33316211850f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:29:02.361010 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4b6a7138-b38d-44a9-a001-33316211850f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:29:02.493493 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4b6a7138-b38d-44a9-a001-33316211850f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:29:02.500937 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4b6a7138-b38d-44a9-a001-33316211850f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.153154 Jul 20 08:29:02.502012 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 236/477] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:29:02 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:29:03.518670 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3c04bea0-657d-4622-9f45-bbd103fa9e0e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:29:03.519276 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-3c04bea0-657d-4622-9f45-bbd103fa9e0e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:29:03.525607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3c04bea0-657d-4622-9f45-bbd103fa9e0e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:29:03.526050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3c04bea0-657d-4622-9f45-bbd103fa9e0e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:29:03.526836 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3c04bea0-657d-4622-9f45-bbd103fa9e0e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:29:03.527267 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3c04bea0-657d-4622-9f45-bbd103fa9e0e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:29:03.661522 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3c04bea0-657d-4622-9f45-bbd103fa9e0e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:29:03.670362 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-3c04bea0-657d-4622-9f45-bbd103fa9e0e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.155080 Jul 20 08:29:03.670362 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 242/478] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:29:03 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:29:04.692565 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d25eae6c-5a60-4233-903d-f915d44840f4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:29:04.693089 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d25eae6c-5a60-4233-903d-f915d44840f4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:29:04.699553 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d25eae6c-5a60-4233-903d-f915d44840f4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:29:04.700026 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d25eae6c-5a60-4233-903d-f915d44840f4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:29:04.700787 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d25eae6c-5a60-4233-903d-f915d44840f4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:29:04.701216 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d25eae6c-5a60-4233-903d-f915d44840f4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:29:04.832311 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d25eae6c-5a60-4233-903d-f915d44840f4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:29:04.839875 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d25eae6c-5a60-4233-903d-f915d44840f4 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.151309 Jul 20 08:29:04.840440 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 237/479] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:29:04 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:29:05.856359 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9d1ea5d0-a0ac-4b4b-a364-79227274b83b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:29:05.856966 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9d1ea5d0-a0ac-4b4b-a364-79227274b83b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:29:05.863829 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9d1ea5d0-a0ac-4b4b-a364-79227274b83b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:29:05.864279 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9d1ea5d0-a0ac-4b4b-a364-79227274b83b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:29:05.865043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9d1ea5d0-a0ac-4b4b-a364-79227274b83b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:29:05.865478 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9d1ea5d0-a0ac-4b4b-a364-79227274b83b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:29:05.996907 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9d1ea5d0-a0ac-4b4b-a364-79227274b83b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:29:06.005219 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9d1ea5d0-a0ac-4b4b-a364-79227274b83b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.152702 Jul 20 08:29:06.005781 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 243/480] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:29:05 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:29:07.022144 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-094f29e3-b12b-4986-a0a9-980eb8ce4c91 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:29:07.022805 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-094f29e3-b12b-4986-a0a9-980eb8ce4c91 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:29:07.029515 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-094f29e3-b12b-4986-a0a9-980eb8ce4c91 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:29:07.029959 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-094f29e3-b12b-4986-a0a9-980eb8ce4c91 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:29:07.030764 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-094f29e3-b12b-4986-a0a9-980eb8ce4c91 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:29:07.031202 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-094f29e3-b12b-4986-a0a9-980eb8ce4c91 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:29:07.165191 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-094f29e3-b12b-4986-a0a9-980eb8ce4c91 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:29:07.172634 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-094f29e3-b12b-4986-a0a9-980eb8ce4c91 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1371 microversion: 2.1 time: 0.154325 Jul 20 08:29:07.173707 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 238/481] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:29:07 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:29:08.190542 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-761c8f0a-b213-4885-a836-66195a1ee913 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:29:08.191139 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-761c8f0a-b213-4885-a836-66195a1ee913 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:29:08.197446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-761c8f0a-b213-4885-a836-66195a1ee913 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:29:08.198006 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-761c8f0a-b213-4885-a836-66195a1ee913 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:29:08.198921 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-761c8f0a-b213-4885-a836-66195a1ee913 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:29:08.199358 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-761c8f0a-b213-4885-a836-66195a1ee913 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:29:08.344070 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-761c8f0a-b213-4885-a836-66195a1ee913 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:29:08.352176 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-761c8f0a-b213-4885-a836-66195a1ee913 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1566 microversion: 2.1 time: 0.166278 Jul 20 08:29:08.352746 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 244/482] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:29:08 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:29:08.368514 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-1f1d7079-06e6-4327-9e09-a27163c59c50 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:29:08.369067 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-1f1d7079-06e6-4327-9e09-a27163c59c50 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:29:08.375568 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1f1d7079-06e6-4327-9e09-a27163c59c50 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:29:08.376017 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1f1d7079-06e6-4327-9e09-a27163c59c50 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:29:08.377337 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1f1d7079-06e6-4327-9e09-a27163c59c50 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:29:08.377774 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1f1d7079-06e6-4327-9e09-a27163c59c50 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:29:08.457901 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-1f1d7079-06e6-4327-9e09-a27163c59c50 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093262 Jul 20 08:29:08.458500 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 239/483] 10.222.0.64 () {58 vars in 1274 bytes} [Wed Jul 20 08:29:08 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:29:09.428519 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-6873ad3d-0925-42e7-9a1a-b9d9d3fc15e2 req-566c892d-f57a-4981-9087-fd8857a1f981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd05a594-404a-4d6e-ab1a-ee3aacb3970d", "tag": "3cddf9c2-1c8a-40e4-8522-773a3957740b"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:29:09.432398 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:29:09.438223 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-6873ad3d-0925-42e7-9a1a-b9d9d3fc15e2 req-566c892d-f57a-4981-9087-fd8857a1f981 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:29:09.438695 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-6873ad3d-0925-42e7-9a1a-b9d9d3fc15e2 req-566c892d-f57a-4981-9087-fd8857a1f981 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:29:09.451096 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-6873ad3d-0925-42e7-9a1a-b9d9d3fc15e2 req-566c892d-f57a-4981-9087-fd8857a1f981 service nova] Creating event network-changed:3cddf9c2-1c8a-40e4-8522-773a3957740b for instance bd05a594-404a-4d6e-ab1a-ee3aacb3970d on hv-cinder-82308 Jul 20 08:29:09.457308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-6873ad3d-0925-42e7-9a1a-b9d9d3fc15e2 req-566c892d-f57a-4981-9087-fd8857a1f981 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032310 Jul 20 08:29:09.458054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 245/484] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:29:09.870495 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 08:29:09.870696 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Wed Jul 20 08:29:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 08:29:50.692623 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=41 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:29:50.693407 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=35 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:29:50.878513 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-2fada7cd-6df8-46f0-8dfc-50d835234794 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Action: 'create', calling method: .version_select at 0x7fe39a015040>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-626472504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESwDdnXKPTRWTekE95JKpJoxJacf0Z0Yjzy00nP8rfO5NFlM+GcNOLiytOQjUw33O8DA9lyVmn4+LvhSqQQzDeSBj52ailDYA5LST5Xwaf582RMCI1hIEboYc9ByfSb/w=="}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:29:50.894530 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-2fada7cd-6df8-46f0-8dfc-50d835234794 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Getting quotas for project fcfc8ebb18c54de29556d0b93593d676. Resources: {'key_pairs'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:29:50.899875 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-2fada7cd-6df8-46f0-8dfc-50d835234794 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Getting quotas for user 19024dea6ca94745b38158beb08f29fc and project fcfc8ebb18c54de29556d0b93593d676. Resources: {'key_pairs'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:29:50.929231 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-2fada7cd-6df8-46f0-8dfc-50d835234794 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.238348 Jul 20 08:29:50.930251 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 240/485] 10.222.0.64 () {60 vars in 1158 bytes} [Wed Jul 20 08:29:50 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:30:14.447651 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=39 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:30:14.448474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:30:14.909114 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e238a594-3483-4682-93ef-8209ecaa386d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Action: 'create', calling method: .version_select at 0x7fe3996b91f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-981622055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjDWmQrmOv9FNJ7ZrLNjyYq7zNBBuImuCXEen9twPo2I9QpV/IAa5cK39OZL9d8rG7ahkOn5hzv8OWqVK17E6/2j/ZffFEpH//5PmZ54dHKUVncm7dqvJ2owfMlhiP+fQ=="}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:30:14.945928 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-e238a594-3483-4682-93ef-8209ecaa386d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Getting quotas for project 714941c1e0034a37b0bf0144c1eac958. Resources: {'key_pairs'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:30:14.952521 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-e238a594-3483-4682-93ef-8209ecaa386d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Getting quotas for user 9c3ca706dfed4770a1eef107b28a9233 and project 714941c1e0034a37b0bf0144c1eac958. Resources: {'key_pairs'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:30:15.019889 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e238a594-3483-4682-93ef-8209ecaa386d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.572583 Jul 20 08:30:15.028323 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 246/486] 10.222.0.64 () {60 vars in 1158 bytes} [Wed Jul 20 08:30:14 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:30:21.533377 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=4 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:30:21.535561 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:30:21.542220 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f306fa37-c4ea-4fb1-bdb4-708cc3da28b4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2008943824", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-626472504", "security_groups": [{"name": "tempest-secgroup-smoke-1425617466"}], "block_device_mapping_v2": [{"uuid": "cbaa8b0b-508e-4620-9ee7-4c694038cad5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "348269a8-7968-40a5-99e7-854f19c8d583"}]}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:30:21.887560 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.network.neutron [None req-f306fa37-c4ea-4fb1-bdb4-708cc3da28b4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] validate_networks() for [('348269a8-7968-40a5-99e7-854f19c8d583', None, None, None, None, None)] {{(pid=117829) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:30:22.695064 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-f306fa37-c4ea-4fb1-bdb4-708cc3da28b4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Flavor limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:30:22.700441 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-f306fa37-c4ea-4fb1-bdb4-708cc3da28b4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Image limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:30:22.703902 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-f306fa37-c4ea-4fb1-bdb4-708cc3da28b4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Flavor pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:30:22.704334 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-f306fa37-c4ea-4fb1-bdb4-708cc3da28b4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Image pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:30:22.707089 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-f306fa37-c4ea-4fb1-bdb4-708cc3da28b4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:30:22.732435 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f306fa37-c4ea-4fb1-bdb4-708cc3da28b4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:22.733423 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f306fa37-c4ea-4fb1-bdb4-708cc3da28b4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:22.734516 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f306fa37-c4ea-4fb1-bdb4-708cc3da28b4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:22.737148 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f306fa37-c4ea-4fb1-bdb4-708cc3da28b4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:22.782770 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-f306fa37-c4ea-4fb1-bdb4-708cc3da28b4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Getting quotas for project fcfc8ebb18c54de29556d0b93593d676. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:30:22.788835 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-f306fa37-c4ea-4fb1-bdb4-708cc3da28b4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Getting quotas for user 19024dea6ca94745b38158beb08f29fc and project fcfc8ebb18c54de29556d0b93593d676. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:30:22.876732 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f306fa37-c4ea-4fb1-bdb4-708cc3da28b4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Going to run 1 instances... {{(pid=117829) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:30:22.879053 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f306fa37-c4ea-4fb1-bdb4-708cc3da28b4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cbaa8b0b-508e-4620-9ee7-4c694038cad5',volume_size=None,volume_type=None)] {{(pid=117829) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:30:23.098058 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f306fa37-c4ea-4fb1-bdb4-708cc3da28b4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.565862 Jul 20 08:30:23.109172 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-6dc53b05-75d5-43be-bc0d-a23a626063b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:23.109900 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-6dc53b05-75d5-43be-bc0d-a23a626063b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:23.120276 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 241/487] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Jul 20 08:30:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 08:30:23.204783 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-6dc53b05-75d5-43be-bc0d-a23a626063b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:23.213376 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-6dc53b05-75d5-43be-bc0d-a23a626063b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1094 microversion: 2.1 time: 0.108198 Jul 20 08:30:23.215141 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 247/488] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:23 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1094 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:24.233473 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9fbda985-af8a-4e0b-af94-e2082ed34d7a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:24.234252 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9fbda985-af8a-4e0b-af94-e2082ed34d7a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:24.243322 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9fbda985-af8a-4e0b-af94-e2082ed34d7a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:24.243787 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9fbda985-af8a-4e0b-af94-e2082ed34d7a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:24.244737 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9fbda985-af8a-4e0b-af94-e2082ed34d7a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:24.245181 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9fbda985-af8a-4e0b-af94-e2082ed34d7a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:24.341119 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9fbda985-af8a-4e0b-af94-e2082ed34d7a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:24.355300 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9fbda985-af8a-4e0b-af94-e2082ed34d7a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1192 microversion: 2.1 time: 0.126917 Jul 20 08:30:24.365298 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 242/489] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:24 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1192 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:25.398786 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-88cb9d3d-c555-4eb6-9c90-5538c364526c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:25.400559 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-88cb9d3d-c555-4eb6-9c90-5538c364526c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:25.418900 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-88cb9d3d-c555-4eb6-9c90-5538c364526c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:25.419762 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-88cb9d3d-c555-4eb6-9c90-5538c364526c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:25.426866 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-88cb9d3d-c555-4eb6-9c90-5538c364526c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:25.427871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-88cb9d3d-c555-4eb6-9c90-5538c364526c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:25.516443 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-88cb9d3d-c555-4eb6-9c90-5538c364526c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:25.529968 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-88cb9d3d-c555-4eb6-9c90-5538c364526c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1210 microversion: 2.1 time: 0.147820 Jul 20 08:30:25.531352 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 248/490] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:25 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1210 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:26.555244 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5f563775-99b5-4a33-8db5-67104dd56b7a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:26.556196 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5f563775-99b5-4a33-8db5-67104dd56b7a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:26.567087 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5f563775-99b5-4a33-8db5-67104dd56b7a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:26.567861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5f563775-99b5-4a33-8db5-67104dd56b7a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:26.568860 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5f563775-99b5-4a33-8db5-67104dd56b7a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:26.569697 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5f563775-99b5-4a33-8db5-67104dd56b7a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:26.832737 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5f563775-99b5-4a33-8db5-67104dd56b7a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:26.842150 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5f563775-99b5-4a33-8db5-67104dd56b7a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.291448 Jul 20 08:30:26.854176 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 243/491] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:26 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:27.262697 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-e3914019-642a-4419-b477-e53cd0d07a24 req-6293bbb9-d958-4885-928e-12d1ff871b99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15050cb9-f79e-4546-b875-1b4e338312fa", "tag": "91e7ab01-3fe6-490c-8584-7db55fc13380"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:30:27.287068 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-e3914019-642a-4419-b477-e53cd0d07a24 req-6293bbb9-d958-4885-928e-12d1ff871b99 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:27.287505 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-e3914019-642a-4419-b477-e53cd0d07a24 req-6293bbb9-d958-4885-928e-12d1ff871b99 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:27.326647 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-e3914019-642a-4419-b477-e53cd0d07a24 req-6293bbb9-d958-4885-928e-12d1ff871b99 service nova] Creating event network-changed:91e7ab01-3fe6-490c-8584-7db55fc13380 for instance 15050cb9-f79e-4546-b875-1b4e338312fa on hv-cinder-82308 Jul 20 08:30:27.335333 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-e3914019-642a-4419-b477-e53cd0d07a24 req-6293bbb9-d958-4885-928e-12d1ff871b99 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076876 Jul 20 08:30:27.353246 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 249/492] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:30:27.871936 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6b3abcfe-b6f0-4f34-bf2c-a8174d184039 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:27.873132 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6b3abcfe-b6f0-4f34-bf2c-a8174d184039 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:27.889952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6b3abcfe-b6f0-4f34-bf2c-a8174d184039 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:27.891089 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6b3abcfe-b6f0-4f34-bf2c-a8174d184039 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:27.896607 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6b3abcfe-b6f0-4f34-bf2c-a8174d184039 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:27.898328 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6b3abcfe-b6f0-4f34-bf2c-a8174d184039 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:28.212399 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6b3abcfe-b6f0-4f34-bf2c-a8174d184039 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:28.226880 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6b3abcfe-b6f0-4f34-bf2c-a8174d184039 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.358175 Jul 20 08:30:28.231467 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 244/493] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:27 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:29.254457 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d3911e56-c6de-4f1c-bc25-b510a99e8a65 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:29.257546 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d3911e56-c6de-4f1c-bc25-b510a99e8a65 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:29.278174 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d3911e56-c6de-4f1c-bc25-b510a99e8a65 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:29.280684 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d3911e56-c6de-4f1c-bc25-b510a99e8a65 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:29.281632 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d3911e56-c6de-4f1c-bc25-b510a99e8a65 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:29.282192 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d3911e56-c6de-4f1c-bc25-b510a99e8a65 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:29.475042 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d3911e56-c6de-4f1c-bc25-b510a99e8a65 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:29.486776 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d3911e56-c6de-4f1c-bc25-b510a99e8a65 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.241838 Jul 20 08:30:29.490334 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 250/494] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:29 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:30.509605 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5ee38abe-44d3-4af2-9767-2480b0703a2e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:30.510360 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5ee38abe-44d3-4af2-9767-2480b0703a2e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:30.529025 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5ee38abe-44d3-4af2-9767-2480b0703a2e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:30.529486 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5ee38abe-44d3-4af2-9767-2480b0703a2e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:30.530303 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5ee38abe-44d3-4af2-9767-2480b0703a2e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:30.541936 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-84c45648-e715-4efc-828f-60b760908d52 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:30.543353 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-84c45648-e715-4efc-828f-60b760908d52 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:30.547615 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5ee38abe-44d3-4af2-9767-2480b0703a2e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:30.566744 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-84c45648-e715-4efc-828f-60b760908d52 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:30.571574 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-84c45648-e715-4efc-828f-60b760908d52 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:30.581945 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-84c45648-e715-4efc-828f-60b760908d52 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:30.588568 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-84c45648-e715-4efc-828f-60b760908d52 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:30.660770 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-84c45648-e715-4efc-828f-60b760908d52 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/ips" status: 200 len: 153 microversion: 2.20 time: 0.123319 Jul 20 08:30:30.661419 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 251/495] 10.222.0.64 () {60 vars in 1288 bytes} [Wed Jul 20 08:30:30 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/ips => generated 153 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:30:31.284346 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5ee38abe-44d3-4af2-9767-2480b0703a2e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:31.315560 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5ee38abe-44d3-4af2-9767-2480b0703a2e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.810641 Jul 20 08:30:31.332329 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 245/496] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:30 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:32.342141 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0122e338-65d0-41d6-92d8-36f194edf44f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:32.344380 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0122e338-65d0-41d6-92d8-36f194edf44f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:32.355262 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0122e338-65d0-41d6-92d8-36f194edf44f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:32.355872 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0122e338-65d0-41d6-92d8-36f194edf44f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:32.357073 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0122e338-65d0-41d6-92d8-36f194edf44f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:32.358100 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0122e338-65d0-41d6-92d8-36f194edf44f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:32.588879 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-0122e338-65d0-41d6-92d8-36f194edf44f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:32.604271 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0122e338-65d0-41d6-92d8-36f194edf44f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.275364 Jul 20 08:30:32.605474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 252/497] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:32 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:33.626593 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-7d175689-62b4-4ae0-b58d-6d127a62e231 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:33.627879 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-7d175689-62b4-4ae0-b58d-6d127a62e231 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:33.632520 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=2 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:30:33.633659 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=6 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:30:33.645912 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7d175689-62b4-4ae0-b58d-6d127a62e231 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:33.646607 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7d175689-62b4-4ae0-b58d-6d127a62e231 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:33.647984 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7d175689-62b4-4ae0-b58d-6d127a62e231 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:33.648694 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7d175689-62b4-4ae0-b58d-6d127a62e231 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:33.896296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-7d175689-62b4-4ae0-b58d-6d127a62e231 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:33.910555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-7d175689-62b4-4ae0-b58d-6d127a62e231 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.292280 Jul 20 08:30:33.911822 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 246/498] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:33 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:34.346805 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ee03276f-ec88-4eec-b494-f4f53f2ff9cd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:30:34.347561 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ee03276f-ec88-4eec-b494-f4f53f2ff9cd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:34.356706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=6 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:30:34.360900 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ee03276f-ec88-4eec-b494-f4f53f2ff9cd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:34.361640 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ee03276f-ec88-4eec-b494-f4f53f2ff9cd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:34.362723 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ee03276f-ec88-4eec-b494-f4f53f2ff9cd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:34.363341 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ee03276f-ec88-4eec-b494-f4f53f2ff9cd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:34.395355 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.objects.instance [None req-ee03276f-ec88-4eec-b494-f4f53f2ff9cd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lazy-loading 'flavor' on Instance uuid 21b295e0-508c-4cd5-b18f-3b808c0ff265 {{(pid=117828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:30:34.771797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ee03276f-ec88-4eec-b494-f4f53f2ff9cd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "POST /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/action" status: 202 len: 0 microversion: 2.20 time: 0.435914 Jul 20 08:30:34.773630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 253/499] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Jul 20 08:30:34 2022] POST /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:30:34.783598 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ecc4141a-3595-4004-a819-03bdb0e46386 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:34.784212 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ecc4141a-3595-4004-a819-03bdb0e46386 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:34.799534 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ecc4141a-3595-4004-a819-03bdb0e46386 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:34.800274 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ecc4141a-3595-4004-a819-03bdb0e46386 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:34.801261 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ecc4141a-3595-4004-a819-03bdb0e46386 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:34.801868 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ecc4141a-3595-4004-a819-03bdb0e46386 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:34.933192 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c77c041e-0b5d-49c0-8d63-b43b8c633713 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:34.933883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c77c041e-0b5d-49c0-8d63-b43b8c633713 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:34.948302 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c77c041e-0b5d-49c0-8d63-b43b8c633713 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:34.951499 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c77c041e-0b5d-49c0-8d63-b43b8c633713 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:34.952847 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c77c041e-0b5d-49c0-8d63-b43b8c633713 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:34.953792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c77c041e-0b5d-49c0-8d63-b43b8c633713 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:35.051011 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ecc4141a-3595-4004-a819-03bdb0e46386 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:35.062306 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ecc4141a-3595-4004-a819-03bdb0e46386 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:35.066195 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ecc4141a-3595-4004-a819-03bdb0e46386 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:35.068149 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ecc4141a-3595-4004-a819-03bdb0e46386 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.288598 Jul 20 08:30:35.070678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 247/500] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:34 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:30:35.295257 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c77c041e-0b5d-49c0-8d63-b43b8c633713 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:35.316130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c77c041e-0b5d-49c0-8d63-b43b8c633713 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.388060 Jul 20 08:30:35.316899 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 254/501] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:34 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:36.092295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5596d720-bc0a-43dc-a157-979e5e41bd24 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:36.092904 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5596d720-bc0a-43dc-a157-979e5e41bd24 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:36.102316 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5596d720-bc0a-43dc-a157-979e5e41bd24 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:36.103345 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5596d720-bc0a-43dc-a157-979e5e41bd24 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:36.104580 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5596d720-bc0a-43dc-a157-979e5e41bd24 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:36.105108 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5596d720-bc0a-43dc-a157-979e5e41bd24 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:36.183568 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0065404b-a3df-4b42-a8b0-891e90b56ffb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Action: 'create', calling method: .version_select at 0x7fe39964da60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-107838149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZqEiZumQvyZFP8sjOvZuZhw06GiOdPMbFVa1XSBG3H9ZHdQljlWOqqApgcEL8E4mpoW1E5Ru8kw2aeUlWMG2IB7MYs/FHkVANUMlylBCBvuHlCSkK6sjdoJlwk5pRHyw=="}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:30:36.205597 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-0065404b-a3df-4b42-a8b0-891e90b56ffb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Getting quotas for project 5732783c305f47a389104f7ea5ac5fcf. Resources: {'key_pairs'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:30:36.214747 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-0065404b-a3df-4b42-a8b0-891e90b56ffb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Getting quotas for user 482e2d3af7994b6692af6a4fa17dde1d and project 5732783c305f47a389104f7ea5ac5fcf. Resources: {'key_pairs'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:30:36.257991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0065404b-a3df-4b42-a8b0-891e90b56ffb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.077831 Jul 20 08:30:36.258893 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 255/502] 10.222.0.64 () {60 vars in 1158 bytes} [Wed Jul 20 08:30:36 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:30:36.310885 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5596d720-bc0a-43dc-a157-979e5e41bd24 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:36.335124 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5596d720-bc0a-43dc-a157-979e5e41bd24 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:36.336571 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-21c19ad9-fd69-4733-8663-29287a693165 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:36.337007 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5596d720-bc0a-43dc-a157-979e5e41bd24 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:36.337247 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-21c19ad9-fd69-4733-8663-29287a693165 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:36.339105 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5596d720-bc0a-43dc-a157-979e5e41bd24 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.250547 Jul 20 08:30:36.343903 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-21c19ad9-fd69-4733-8663-29287a693165 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:36.344343 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-21c19ad9-fd69-4733-8663-29287a693165 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:36.345116 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-21c19ad9-fd69-4733-8663-29287a693165 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:36.345910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-21c19ad9-fd69-4733-8663-29287a693165 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:36.347055 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 248/503] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:36 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:30:36.379547 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-cf603445-c6d2-49b8-a9ed-97a37d881e8f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1125158520", "imageRef": "64ca64c4-3294-4ce6-8cfb-a824c051eb0a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-107838149", "networks": [{"uuid": "abdb2b01-7e23-48cd-9c85-17299972804b"}]}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:30:36.451543 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.network.neutron [None req-cf603445-c6d2-49b8-a9ed-97a37d881e8f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] validate_networks() for [('abdb2b01-7e23-48cd-9c85-17299972804b', None, None, None, None, None)] {{(pid=117829) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:30:36.529486 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-21c19ad9-fd69-4733-8663-29287a693165 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:36.537868 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-21c19ad9-fd69-4733-8663-29287a693165 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.207177 Jul 20 08:30:36.538492 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 256/504] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:36 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:36.966962 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-cf603445-c6d2-49b8-a9ed-97a37d881e8f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Flavor limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:30:36.967381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-cf603445-c6d2-49b8-a9ed-97a37d881e8f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Image limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:30:36.967885 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-cf603445-c6d2-49b8-a9ed-97a37d881e8f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Flavor pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:30:36.968285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-cf603445-c6d2-49b8-a9ed-97a37d881e8f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Image pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:30:36.968757 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-cf603445-c6d2-49b8-a9ed-97a37d881e8f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:30:36.981645 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cf603445-c6d2-49b8-a9ed-97a37d881e8f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:36.982087 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cf603445-c6d2-49b8-a9ed-97a37d881e8f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:36.982957 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cf603445-c6d2-49b8-a9ed-97a37d881e8f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:36.983386 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cf603445-c6d2-49b8-a9ed-97a37d881e8f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:37.007995 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-cf603445-c6d2-49b8-a9ed-97a37d881e8f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Getting quotas for project 5732783c305f47a389104f7ea5ac5fcf. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:30:37.018478 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-cf603445-c6d2-49b8-a9ed-97a37d881e8f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Getting quotas for user 482e2d3af7994b6692af6a4fa17dde1d and project 5732783c305f47a389104f7ea5ac5fcf. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:30:37.040228 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-cf603445-c6d2-49b8-a9ed-97a37d881e8f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Going to run 1 instances... {{(pid=117829) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:30:37.043559 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-cf603445-c6d2-49b8-a9ed-97a37d881e8f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64ca64c4-3294-4ce6-8cfb-a824c051eb0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117829) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:30:37.094420 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-cf603445-c6d2-49b8-a9ed-97a37d881e8f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719753 Jul 20 08:30:37.095632 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 249/505] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Jul 20 08:30:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 08:30:37.110833 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-49981081-a680-4e6b-b035-f85637c8541e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:37.111498 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-49981081-a680-4e6b-b035-f85637c8541e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:37.175581 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-49981081-a680-4e6b-b035-f85637c8541e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:37.186050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-49981081-a680-4e6b-b035-f85637c8541e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1258 microversion: 2.1 time: 0.080360 Jul 20 08:30:37.186907 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 257/506] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:37 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1258 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:37.359392 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-b276ad2d-ab03-4d3f-9f60-ec7ba0e754d2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:37.359991 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-b276ad2d-ab03-4d3f-9f60-ec7ba0e754d2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:37.367420 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b276ad2d-ab03-4d3f-9f60-ec7ba0e754d2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:37.367797 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b276ad2d-ab03-4d3f-9f60-ec7ba0e754d2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:37.368595 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b276ad2d-ab03-4d3f-9f60-ec7ba0e754d2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:37.369023 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b276ad2d-ab03-4d3f-9f60-ec7ba0e754d2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:37.562100 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5353da4d-e09d-4189-befc-8f63671c85be tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:37.563914 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-5353da4d-e09d-4189-befc-8f63671c85be tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:37.564817 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b276ad2d-ab03-4d3f-9f60-ec7ba0e754d2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:37.578760 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5353da4d-e09d-4189-befc-8f63671c85be tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:37.579604 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5353da4d-e09d-4189-befc-8f63671c85be tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:37.580632 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5353da4d-e09d-4189-befc-8f63671c85be tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:37.580926 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b276ad2d-ab03-4d3f-9f60-ec7ba0e754d2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:37.581437 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5353da4d-e09d-4189-befc-8f63671c85be tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:37.592491 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b276ad2d-ab03-4d3f-9f60-ec7ba0e754d2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:37.593980 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-b276ad2d-ab03-4d3f-9f60-ec7ba0e754d2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.238951 Jul 20 08:30:37.594898 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 250/507] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:37 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:30:37.767733 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5353da4d-e09d-4189-befc-8f63671c85be tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:37.778924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-5353da4d-e09d-4189-befc-8f63671c85be tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.221684 Jul 20 08:30:37.779569 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 258/508] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:37 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:38.210712 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4ca6099d-ef0f-46b3-8069-281367d62f7d tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:38.212260 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4ca6099d-ef0f-46b3-8069-281367d62f7d tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:38.218897 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4ca6099d-ef0f-46b3-8069-281367d62f7d tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:38.219339 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4ca6099d-ef0f-46b3-8069-281367d62f7d tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:38.222119 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4ca6099d-ef0f-46b3-8069-281367d62f7d tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:38.222572 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4ca6099d-ef0f-46b3-8069-281367d62f7d tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:38.299258 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4ca6099d-ef0f-46b3-8069-281367d62f7d tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:38.310574 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4ca6099d-ef0f-46b3-8069-281367d62f7d tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1262 microversion: 2.1 time: 0.106310 Jul 20 08:30:38.311175 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 251/509] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:38 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1262 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:38.624848 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-34f726de-d7a5-4594-a722-f0a7affec210 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:38.626016 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-34f726de-d7a5-4594-a722-f0a7affec210 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:38.635949 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-34f726de-d7a5-4594-a722-f0a7affec210 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:38.636687 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-34f726de-d7a5-4594-a722-f0a7affec210 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:38.637486 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-34f726de-d7a5-4594-a722-f0a7affec210 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:38.638295 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-34f726de-d7a5-4594-a722-f0a7affec210 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:38.806447 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e68cfd1f-cca9-4d53-820d-a39daafb8778 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:38.807557 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e68cfd1f-cca9-4d53-820d-a39daafb8778 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:38.819478 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e68cfd1f-cca9-4d53-820d-a39daafb8778 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:38.823036 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e68cfd1f-cca9-4d53-820d-a39daafb8778 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:38.823656 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e68cfd1f-cca9-4d53-820d-a39daafb8778 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:38.828447 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e68cfd1f-cca9-4d53-820d-a39daafb8778 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:38.833423 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-34f726de-d7a5-4594-a722-f0a7affec210 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:38.845270 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-34f726de-d7a5-4594-a722-f0a7affec210 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:38.850061 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-34f726de-d7a5-4594-a722-f0a7affec210 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:38.856359 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-34f726de-d7a5-4594-a722-f0a7affec210 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.237545 Jul 20 08:30:38.863843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 259/510] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:38 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:30:39.321494 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e68cfd1f-cca9-4d53-820d-a39daafb8778 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:39.328880 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-da906b0c-8d62-4ae8-a9bd-b6bf0288ac77 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:39.329608 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-da906b0c-8d62-4ae8-a9bd-b6bf0288ac77 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:39.330709 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e68cfd1f-cca9-4d53-820d-a39daafb8778 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.531168 Jul 20 08:30:39.331400 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 252/511] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:38 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:39.337342 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-da906b0c-8d62-4ae8-a9bd-b6bf0288ac77 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:39.338033 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-da906b0c-8d62-4ae8-a9bd-b6bf0288ac77 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:39.338853 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-da906b0c-8d62-4ae8-a9bd-b6bf0288ac77 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:39.339338 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-da906b0c-8d62-4ae8-a9bd-b6bf0288ac77 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:39.414483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-da906b0c-8d62-4ae8-a9bd-b6bf0288ac77 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:39.426961 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-da906b0c-8d62-4ae8-a9bd-b6bf0288ac77 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1310 microversion: 2.1 time: 0.101614 Jul 20 08:30:39.427969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 260/512] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:39 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1310 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:39.893951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-efbb4e1f-d6fd-4bf0-b7b8-faac0ccc861b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:39.894760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-efbb4e1f-d6fd-4bf0-b7b8-faac0ccc861b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:39.908397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-efbb4e1f-d6fd-4bf0-b7b8-faac0ccc861b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:39.909031 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-efbb4e1f-d6fd-4bf0-b7b8-faac0ccc861b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:39.909903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-efbb4e1f-d6fd-4bf0-b7b8-faac0ccc861b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:39.910599 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-efbb4e1f-d6fd-4bf0-b7b8-faac0ccc861b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:40.231852 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-efbb4e1f-d6fd-4bf0-b7b8-faac0ccc861b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:40.243217 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-efbb4e1f-d6fd-4bf0-b7b8-faac0ccc861b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:40.245367 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-efbb4e1f-d6fd-4bf0-b7b8-faac0ccc861b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:40.246691 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-efbb4e1f-d6fd-4bf0-b7b8-faac0ccc861b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.359449 Jul 20 08:30:40.247383 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 253/513] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:39 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:30:40.352432 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a44e2aba-24a8-4914-a432-ae147ee3f5b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:40.353239 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a44e2aba-24a8-4914-a432-ae147ee3f5b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:40.365632 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a44e2aba-24a8-4914-a432-ae147ee3f5b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:40.366944 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a44e2aba-24a8-4914-a432-ae147ee3f5b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:40.367950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a44e2aba-24a8-4914-a432-ae147ee3f5b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:40.368708 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a44e2aba-24a8-4914-a432-ae147ee3f5b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:40.451497 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-edf9903f-3191-43a3-9c1c-a4462c5b4fdb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:40.452715 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-edf9903f-3191-43a3-9c1c-a4462c5b4fdb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:40.460968 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-edf9903f-3191-43a3-9c1c-a4462c5b4fdb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:40.462303 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-edf9903f-3191-43a3-9c1c-a4462c5b4fdb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:40.466710 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-edf9903f-3191-43a3-9c1c-a4462c5b4fdb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:40.471224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-edf9903f-3191-43a3-9c1c-a4462c5b4fdb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:40.661279 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a44e2aba-24a8-4914-a432-ae147ee3f5b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:40.672645 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a44e2aba-24a8-4914-a432-ae147ee3f5b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.324567 Jul 20 08:30:40.673949 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 261/514] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:40 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:40.773620 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-edf9903f-3191-43a3-9c1c-a4462c5b4fdb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:40.789860 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-edf9903f-3191-43a3-9c1c-a4462c5b4fdb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1316 microversion: 2.1 time: 0.340322 Jul 20 08:30:40.803105 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 254/515] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:40 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:41.267082 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-37de5e06-2cdb-495f-99c2-a2fe8a0e7438 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:41.267956 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-37de5e06-2cdb-495f-99c2-a2fe8a0e7438 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:41.274774 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-37de5e06-2cdb-495f-99c2-a2fe8a0e7438 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:41.275432 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-37de5e06-2cdb-495f-99c2-a2fe8a0e7438 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:41.276894 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-37de5e06-2cdb-495f-99c2-a2fe8a0e7438 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:41.277486 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-37de5e06-2cdb-495f-99c2-a2fe8a0e7438 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:41.463185 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-37de5e06-2cdb-495f-99c2-a2fe8a0e7438 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:41.474335 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-37de5e06-2cdb-495f-99c2-a2fe8a0e7438 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:41.476828 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-37de5e06-2cdb-495f-99c2-a2fe8a0e7438 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:41.478119 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-37de5e06-2cdb-495f-99c2-a2fe8a0e7438 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.216840 Jul 20 08:30:41.478735 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 262/516] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:41 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:30:41.692400 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6ded8af9-1753-415f-b511-da984b3bb84e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:41.693600 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6ded8af9-1753-415f-b511-da984b3bb84e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:41.703854 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6ded8af9-1753-415f-b511-da984b3bb84e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:41.704586 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6ded8af9-1753-415f-b511-da984b3bb84e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:41.705536 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6ded8af9-1753-415f-b511-da984b3bb84e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:41.707277 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6ded8af9-1753-415f-b511-da984b3bb84e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:41.819784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-09604747-c26d-4879-8f52-14d3790cb12a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:41.820403 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-09604747-c26d-4879-8f52-14d3790cb12a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:41.826555 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-09604747-c26d-4879-8f52-14d3790cb12a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:41.827029 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-09604747-c26d-4879-8f52-14d3790cb12a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:41.827809 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-09604747-c26d-4879-8f52-14d3790cb12a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:41.828313 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-09604747-c26d-4879-8f52-14d3790cb12a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:41.857329 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6ded8af9-1753-415f-b511-da984b3bb84e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:41.865187 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6ded8af9-1753-415f-b511-da984b3bb84e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.176807 Jul 20 08:30:41.865674 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 255/517] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:41 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:41.969492 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-09604747-c26d-4879-8f52-14d3790cb12a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:41.978695 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-09604747-c26d-4879-8f52-14d3790cb12a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.162998 Jul 20 08:30:41.979945 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 263/518] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:41 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:42.268060 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-1651957e-f989-43f1-baaa-a63b1ba2af13 req-9dd4d856-e465-4e53-9dc0-652c70c1172e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15050cb9-f79e-4546-b875-1b4e338312fa", "name": "network-vif-plugged", "status": "completed", "tag": "91e7ab01-3fe6-490c-8584-7db55fc13380"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:30:42.281041 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-1651957e-f989-43f1-baaa-a63b1ba2af13 req-9dd4d856-e465-4e53-9dc0-652c70c1172e service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:42.281492 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-1651957e-f989-43f1-baaa-a63b1ba2af13 req-9dd4d856-e465-4e53-9dc0-652c70c1172e service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:42.296211 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-1651957e-f989-43f1-baaa-a63b1ba2af13 req-9dd4d856-e465-4e53-9dc0-652c70c1172e service nova] Creating event network-vif-plugged:91e7ab01-3fe6-490c-8584-7db55fc13380 for instance 15050cb9-f79e-4546-b875-1b4e338312fa on hv-cinder-82308 Jul 20 08:30:42.302912 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-1651957e-f989-43f1-baaa-a63b1ba2af13 req-9dd4d856-e465-4e53-9dc0-652c70c1172e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042279 Jul 20 08:30:42.304377 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 256/519] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:30:42.497397 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-603af6c8-2ad3-4b0b-a007-ad7163019d1c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:42.497937 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-603af6c8-2ad3-4b0b-a007-ad7163019d1c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:42.503961 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-603af6c8-2ad3-4b0b-a007-ad7163019d1c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:42.504409 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-603af6c8-2ad3-4b0b-a007-ad7163019d1c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:42.505178 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-603af6c8-2ad3-4b0b-a007-ad7163019d1c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:42.505609 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-603af6c8-2ad3-4b0b-a007-ad7163019d1c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:42.644236 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-603af6c8-2ad3-4b0b-a007-ad7163019d1c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:42.653142 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-603af6c8-2ad3-4b0b-a007-ad7163019d1c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:42.654661 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-603af6c8-2ad3-4b0b-a007-ad7163019d1c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:42.655823 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-603af6c8-2ad3-4b0b-a007-ad7163019d1c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.162443 Jul 20 08:30:42.656406 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 264/520] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:42 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:30:42.884699 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a7602b59-6b82-425e-ad32-d5b7acac12b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:42.885377 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a7602b59-6b82-425e-ad32-d5b7acac12b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:42.891571 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a7602b59-6b82-425e-ad32-d5b7acac12b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:42.892013 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a7602b59-6b82-425e-ad32-d5b7acac12b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:42.892762 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a7602b59-6b82-425e-ad32-d5b7acac12b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:42.893185 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a7602b59-6b82-425e-ad32-d5b7acac12b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:42.997162 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a4c49677-0373-4fec-b6fe-ff76c72181b5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:42.997781 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a4c49677-0373-4fec-b6fe-ff76c72181b5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:43.005368 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a4c49677-0373-4fec-b6fe-ff76c72181b5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:43.005368 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a4c49677-0373-4fec-b6fe-ff76c72181b5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:43.006554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a4c49677-0373-4fec-b6fe-ff76c72181b5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:43.009771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a4c49677-0373-4fec-b6fe-ff76c72181b5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:43.033832 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:30:43.065816 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a7602b59-6b82-425e-ad32-d5b7acac12b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:43.077011 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a7602b59-6b82-425e-ad32-d5b7acac12b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.197551 Jul 20 08:30:43.077810 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 257/521] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:42 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:43.168385 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a4c49677-0373-4fec-b6fe-ff76c72181b5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:43.175732 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a4c49677-0373-4fec-b6fe-ff76c72181b5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.182844 Jul 20 08:30:43.176289 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 265/522] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:42 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:43.673982 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c9713a64-0a80-467d-b9d5-9d584c742db4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:43.674622 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c9713a64-0a80-467d-b9d5-9d584c742db4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:43.681354 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c9713a64-0a80-467d-b9d5-9d584c742db4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:43.681785 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c9713a64-0a80-467d-b9d5-9d584c742db4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:43.682536 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c9713a64-0a80-467d-b9d5-9d584c742db4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:43.682985 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c9713a64-0a80-467d-b9d5-9d584c742db4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:43.827186 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c9713a64-0a80-467d-b9d5-9d584c742db4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:43.836151 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c9713a64-0a80-467d-b9d5-9d584c742db4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:43.837654 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c9713a64-0a80-467d-b9d5-9d584c742db4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:43.838995 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c9713a64-0a80-467d-b9d5-9d584c742db4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.168877 Jul 20 08:30:43.839560 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 258/523] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:43 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:30:44.093208 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-6fc1bda6-5b5f-4673-bb1d-a6730898b717 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:44.093810 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-6fc1bda6-5b5f-4673-bb1d-a6730898b717 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:44.099877 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6fc1bda6-5b5f-4673-bb1d-a6730898b717 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:44.100880 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6fc1bda6-5b5f-4673-bb1d-a6730898b717 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:44.101901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6fc1bda6-5b5f-4673-bb1d-a6730898b717 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:44.102344 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6fc1bda6-5b5f-4673-bb1d-a6730898b717 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:44.192918 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-1593e9de-69bc-4958-b25e-b816e4050929 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:44.193560 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-1593e9de-69bc-4958-b25e-b816e4050929 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:44.200402 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1593e9de-69bc-4958-b25e-b816e4050929 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:44.200911 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1593e9de-69bc-4958-b25e-b816e4050929 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:44.201723 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1593e9de-69bc-4958-b25e-b816e4050929 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:44.202144 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1593e9de-69bc-4958-b25e-b816e4050929 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:44.222079 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:30:44.243964 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-6fc1bda6-5b5f-4673-bb1d-a6730898b717 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:44.258314 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-6fc1bda6-5b5f-4673-bb1d-a6730898b717 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.168285 Jul 20 08:30:44.269230 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 266/524] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:44 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:44.358599 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1593e9de-69bc-4958-b25e-b816e4050929 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:44.366067 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-1593e9de-69bc-4958-b25e-b816e4050929 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.176921 Jul 20 08:30:44.366656 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 259/525] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:44 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:44.857358 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-2aab03cf-6bff-4a09-a202-a4dcd43b6110 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:44.857949 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-2aab03cf-6bff-4a09-a202-a4dcd43b6110 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:44.859894 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=2 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:30:44.865151 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2aab03cf-6bff-4a09-a202-a4dcd43b6110 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:44.865590 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2aab03cf-6bff-4a09-a202-a4dcd43b6110 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:44.866345 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2aab03cf-6bff-4a09-a202-a4dcd43b6110 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:44.866803 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2aab03cf-6bff-4a09-a202-a4dcd43b6110 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:44.999070 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2aab03cf-6bff-4a09-a202-a4dcd43b6110 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:45.008188 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2aab03cf-6bff-4a09-a202-a4dcd43b6110 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:45.009742 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2aab03cf-6bff-4a09-a202-a4dcd43b6110 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:45.010973 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-2aab03cf-6bff-4a09-a202-a4dcd43b6110 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.157550 Jul 20 08:30:45.012180 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 267/526] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:44 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:30:45.276834 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-eb704a35-c656-4fd1-97bb-17d595a0366a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:45.277423 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-eb704a35-c656-4fd1-97bb-17d595a0366a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:45.283986 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-eb704a35-c656-4fd1-97bb-17d595a0366a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:45.284436 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-eb704a35-c656-4fd1-97bb-17d595a0366a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:45.285202 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-eb704a35-c656-4fd1-97bb-17d595a0366a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:45.285632 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-eb704a35-c656-4fd1-97bb-17d595a0366a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:45.384010 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d6aba200-2cb8-4eb7-9fd7-2a631b042ad5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:45.384630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d6aba200-2cb8-4eb7-9fd7-2a631b042ad5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:45.390854 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d6aba200-2cb8-4eb7-9fd7-2a631b042ad5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:45.391301 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d6aba200-2cb8-4eb7-9fd7-2a631b042ad5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:45.392070 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d6aba200-2cb8-4eb7-9fd7-2a631b042ad5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:45.392503 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d6aba200-2cb8-4eb7-9fd7-2a631b042ad5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:45.426540 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-eb704a35-c656-4fd1-97bb-17d595a0366a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:45.438353 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-eb704a35-c656-4fd1-97bb-17d595a0366a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.164378 Jul 20 08:30:45.451349 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 260/527] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:45 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:45.564279 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d6aba200-2cb8-4eb7-9fd7-2a631b042ad5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:45.571814 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d6aba200-2cb8-4eb7-9fd7-2a631b042ad5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.192590 Jul 20 08:30:45.572370 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 268/528] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:45 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:46.029096 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-1b658c05-3dde-43cd-895f-3feb2745ecbb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:46.029708 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-1b658c05-3dde-43cd-895f-3feb2745ecbb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:46.035790 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1b658c05-3dde-43cd-895f-3feb2745ecbb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:46.036237 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1b658c05-3dde-43cd-895f-3feb2745ecbb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:46.037006 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1b658c05-3dde-43cd-895f-3feb2745ecbb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:46.037439 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1b658c05-3dde-43cd-895f-3feb2745ecbb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:46.170358 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1b658c05-3dde-43cd-895f-3feb2745ecbb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:46.178536 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1b658c05-3dde-43cd-895f-3feb2745ecbb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:46.180322 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1b658c05-3dde-43cd-895f-3feb2745ecbb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:46.181480 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-1b658c05-3dde-43cd-895f-3feb2745ecbb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.156397 Jul 20 08:30:46.182031 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 261/529] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:46 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:30:46.461276 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-105c80d0-ea8b-4a62-bdea-2c1ccc9c5be7 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:46.461886 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-105c80d0-ea8b-4a62-bdea-2c1ccc9c5be7 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:46.467977 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-105c80d0-ea8b-4a62-bdea-2c1ccc9c5be7 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:46.468420 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-105c80d0-ea8b-4a62-bdea-2c1ccc9c5be7 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:46.469172 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-105c80d0-ea8b-4a62-bdea-2c1ccc9c5be7 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:46.469604 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-105c80d0-ea8b-4a62-bdea-2c1ccc9c5be7 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:46.589377 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-05a50404-4c94-4dc4-b194-1b2707513121 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:46.589994 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-05a50404-4c94-4dc4-b194-1b2707513121 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:46.598497 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-05a50404-4c94-4dc4-b194-1b2707513121 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:46.599276 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-05a50404-4c94-4dc4-b194-1b2707513121 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:46.600112 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-05a50404-4c94-4dc4-b194-1b2707513121 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:46.600699 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-05a50404-4c94-4dc4-b194-1b2707513121 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:46.628642 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-105c80d0-ea8b-4a62-bdea-2c1ccc9c5be7 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:46.637349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-105c80d0-ea8b-4a62-bdea-2c1ccc9c5be7 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.180748 Jul 20 08:30:46.638219 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 269/530] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:46 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:46.744450 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-05a50404-4c94-4dc4-b194-1b2707513121 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:46.752314 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-05a50404-4c94-4dc4-b194-1b2707513121 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.167413 Jul 20 08:30:46.753197 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 262/531] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:46 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:47.199705 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e09ff6bc-3e72-4cbc-8773-4def271f8ba0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:47.200374 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-e09ff6bc-3e72-4cbc-8773-4def271f8ba0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:47.202438 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=6 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:30:47.208178 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e09ff6bc-3e72-4cbc-8773-4def271f8ba0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:47.209013 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e09ff6bc-3e72-4cbc-8773-4def271f8ba0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:47.209894 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e09ff6bc-3e72-4cbc-8773-4def271f8ba0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:47.210386 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e09ff6bc-3e72-4cbc-8773-4def271f8ba0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:47.363052 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e09ff6bc-3e72-4cbc-8773-4def271f8ba0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:47.371035 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e09ff6bc-3e72-4cbc-8773-4def271f8ba0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:47.372528 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e09ff6bc-3e72-4cbc-8773-4def271f8ba0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:47.373682 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e09ff6bc-3e72-4cbc-8773-4def271f8ba0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.178525 Jul 20 08:30:47.374235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 270/532] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:47 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:30:47.654688 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-bb3413fa-9c37-489f-8b84-04a1b5d3ad70 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:47.655302 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-bb3413fa-9c37-489f-8b84-04a1b5d3ad70 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:47.657831 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=2 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:30:47.658848 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=6 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:30:47.668157 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bb3413fa-9c37-489f-8b84-04a1b5d3ad70 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:47.668758 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bb3413fa-9c37-489f-8b84-04a1b5d3ad70 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:47.669660 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bb3413fa-9c37-489f-8b84-04a1b5d3ad70 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:47.670354 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bb3413fa-9c37-489f-8b84-04a1b5d3ad70 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:47.769318 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1ca45faa-83ee-4b7d-8e03-e3efccda4905 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:47.770149 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1ca45faa-83ee-4b7d-8e03-e3efccda4905 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:47.777530 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1ca45faa-83ee-4b7d-8e03-e3efccda4905 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:47.777973 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1ca45faa-83ee-4b7d-8e03-e3efccda4905 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:47.778801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1ca45faa-83ee-4b7d-8e03-e3efccda4905 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:47.779227 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1ca45faa-83ee-4b7d-8e03-e3efccda4905 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:47.823611 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-bb3413fa-9c37-489f-8b84-04a1b5d3ad70 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:47.831739 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-bb3413fa-9c37-489f-8b84-04a1b5d3ad70 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.181140 Jul 20 08:30:47.832175 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 263/533] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:47 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:47.914066 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1ca45faa-83ee-4b7d-8e03-e3efccda4905 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:47.921552 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1ca45faa-83ee-4b7d-8e03-e3efccda4905 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.156182 Jul 20 08:30:47.922113 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 271/534] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:47 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:48.392384 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d9069223-7101-4626-afc1-092fb4e4cfd2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:48.393005 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d9069223-7101-4626-afc1-092fb4e4cfd2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:48.399276 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d9069223-7101-4626-afc1-092fb4e4cfd2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:48.399806 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d9069223-7101-4626-afc1-092fb4e4cfd2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:48.400649 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d9069223-7101-4626-afc1-092fb4e4cfd2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:48.401157 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d9069223-7101-4626-afc1-092fb4e4cfd2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:48.532455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d9069223-7101-4626-afc1-092fb4e4cfd2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:48.541377 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d9069223-7101-4626-afc1-092fb4e4cfd2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:48.542971 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d9069223-7101-4626-afc1-092fb4e4cfd2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:48.544244 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d9069223-7101-4626-afc1-092fb4e4cfd2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.155890 Jul 20 08:30:48.544796 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 264/535] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:48 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:30:48.849832 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b489925f-230c-4ddf-8376-34378c4713c0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:48.850516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b489925f-230c-4ddf-8376-34378c4713c0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:48.857253 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b489925f-230c-4ddf-8376-34378c4713c0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:48.857716 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b489925f-230c-4ddf-8376-34378c4713c0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:48.858459 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b489925f-230c-4ddf-8376-34378c4713c0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:48.858924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b489925f-230c-4ddf-8376-34378c4713c0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:48.942436 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5f881e02-a953-4624-9af9-99df94b0907c tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:48.945758 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5f881e02-a953-4624-9af9-99df94b0907c tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:48.957915 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5f881e02-a953-4624-9af9-99df94b0907c tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:48.959200 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5f881e02-a953-4624-9af9-99df94b0907c tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:48.961475 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5f881e02-a953-4624-9af9-99df94b0907c tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:48.962548 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5f881e02-a953-4624-9af9-99df94b0907c tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:48.999397 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b489925f-230c-4ddf-8376-34378c4713c0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:49.035973 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b489925f-230c-4ddf-8376-34378c4713c0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.189915 Jul 20 08:30:49.048374 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 272/536] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:48 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:49.116506 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5f881e02-a953-4624-9af9-99df94b0907c tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:49.124088 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5f881e02-a953-4624-9af9-99df94b0907c tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.189980 Jul 20 08:30:49.124640 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 265/537] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:48 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:49.354262 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7f16bf01-3d7c-4180-b88e-74bdb2423324 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:49.354774 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-7f16bf01-3d7c-4180-b88e-74bdb2423324 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:49.361009 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7f16bf01-3d7c-4180-b88e-74bdb2423324 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:49.361451 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7f16bf01-3d7c-4180-b88e-74bdb2423324 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:49.362204 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7f16bf01-3d7c-4180-b88e-74bdb2423324 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:49.362661 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7f16bf01-3d7c-4180-b88e-74bdb2423324 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:49.385792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-7f16bf01-3d7c-4180-b88e-74bdb2423324 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650/ips" status: 200 len: 148 microversion: 2.1 time: 0.035415 Jul 20 08:30:49.386357 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 273/538] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Jul 20 08:30:49 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:30:49.684014 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-03049c8b-d08d-494c-b743-ff8020a283a6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:49.684676 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-03049c8b-d08d-494c-b743-ff8020a283a6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:49.701127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-03049c8b-d08d-494c-b743-ff8020a283a6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:49.702101 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-03049c8b-d08d-494c-b743-ff8020a283a6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:49.703215 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-03049c8b-d08d-494c-b743-ff8020a283a6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:49.703861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-03049c8b-d08d-494c-b743-ff8020a283a6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:49.798179 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d0c08f77-d197-4d4a-a31d-f9ecdc4ed75e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-408469423", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-981622055", "security_groups": [{"name": "tempest-secgroup-smoke-297282020"}], "networks": [{"uuid": "25f446cb-7a17-4014-9d26-36b89d0e107f"}], "block_device_mapping_v2": [{"uuid": "18d86697-6fc5-4934-8c43-321e1d3aaca4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:30:49.923145 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-03049c8b-d08d-494c-b743-ff8020a283a6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:49.932002 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-03049c8b-d08d-494c-b743-ff8020a283a6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:49.933508 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-03049c8b-d08d-494c-b743-ff8020a283a6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:49.934687 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-03049c8b-d08d-494c-b743-ff8020a283a6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.375145 Jul 20 08:30:49.935248 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 266/539] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:49 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:30:49.937505 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.network.neutron [None req-d0c08f77-d197-4d4a-a31d-f9ecdc4ed75e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] validate_networks() for [('25f446cb-7a17-4014-9d26-36b89d0e107f', None, None, None, None, None)] {{(pid=117828) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:30:50.056906 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-7a1978bf-09e5-4105-ba35-dbd9a01563d5 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:50.058262 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-7a1978bf-09e5-4105-ba35-dbd9a01563d5 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:50.068920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7a1978bf-09e5-4105-ba35-dbd9a01563d5 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:50.069583 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7a1978bf-09e5-4105-ba35-dbd9a01563d5 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:50.070573 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7a1978bf-09e5-4105-ba35-dbd9a01563d5 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:50.071034 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7a1978bf-09e5-4105-ba35-dbd9a01563d5 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:50.223025 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-7a1978bf-09e5-4105-ba35-dbd9a01563d5 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:50.231452 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-7a1978bf-09e5-4105-ba35-dbd9a01563d5 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.179181 Jul 20 08:30:50.232044 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 267/540] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:50 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:50.236578 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-10e330fc-16d2-4253-9ccf-bd67a7c3411e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:50.237648 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-10e330fc-16d2-4253-9ccf-bd67a7c3411e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:50.245606 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-10e330fc-16d2-4253-9ccf-bd67a7c3411e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:50.246053 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-10e330fc-16d2-4253-9ccf-bd67a7c3411e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:50.246861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-10e330fc-16d2-4253-9ccf-bd67a7c3411e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:50.247304 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-10e330fc-16d2-4253-9ccf-bd67a7c3411e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:50.374990 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-d0c08f77-d197-4d4a-a31d-f9ecdc4ed75e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Flavor limits 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:30:50.376326 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-d0c08f77-d197-4d4a-a31d-f9ecdc4ed75e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Image limits 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:30:50.377045 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-d0c08f77-d197-4d4a-a31d-f9ecdc4ed75e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Flavor pref 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:30:50.377694 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-d0c08f77-d197-4d4a-a31d-f9ecdc4ed75e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Image pref 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:30:50.378332 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-d0c08f77-d197-4d4a-a31d-f9ecdc4ed75e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:30:50.391714 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-10e330fc-16d2-4253-9ccf-bd67a7c3411e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:50.399003 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d0c08f77-d197-4d4a-a31d-f9ecdc4ed75e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:50.400748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-10e330fc-16d2-4253-9ccf-bd67a7c3411e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.167672 Jul 20 08:30:50.401658 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 268/541] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:50 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:50.402420 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d0c08f77-d197-4d4a-a31d-f9ecdc4ed75e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:50.404486 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d0c08f77-d197-4d4a-a31d-f9ecdc4ed75e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:50.406072 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d0c08f77-d197-4d4a-a31d-f9ecdc4ed75e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:50.427179 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-d0c08f77-d197-4d4a-a31d-f9ecdc4ed75e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Getting quotas for project 714941c1e0034a37b0bf0144c1eac958. Resources: {'cores', 'ram', 'instances'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:30:50.438194 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-d0c08f77-d197-4d4a-a31d-f9ecdc4ed75e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Getting quotas for user 9c3ca706dfed4770a1eef107b28a9233 and project 714941c1e0034a37b0bf0144c1eac958. Resources: {'cores', 'ram', 'instances'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:30:50.493298 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d0c08f77-d197-4d4a-a31d-f9ecdc4ed75e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Going to run 1 instances... {{(pid=117828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:30:50.495408 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d0c08f77-d197-4d4a-a31d-f9ecdc4ed75e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='18d86697-6fc5-4934-8c43-321e1d3aaca4',volume_size=None,volume_type=None)] {{(pid=117828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:30:50.656904 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d0c08f77-d197-4d4a-a31d-f9ecdc4ed75e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.865802 Jul 20 08:30:50.657496 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 274/542] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Jul 20 08:30:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 08:30:50.668615 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-0914a823-1c0c-464c-bc34-df1d5c54914a tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:50.669464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-0914a823-1c0c-464c-bc34-df1d5c54914a tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:50.723577 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0914a823-1c0c-464c-bc34-df1d5c54914a tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:50.731429 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-0914a823-1c0c-464c-bc34-df1d5c54914a tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1087 microversion: 2.1 time: 0.066856 Jul 20 08:30:50.732005 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 269/543] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:50 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1087 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:50.953495 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e5a64fc2-04d1-4334-a0cf-a5e71a341649 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:50.954100 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-e5a64fc2-04d1-4334-a0cf-a5e71a341649 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:50.963084 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e5a64fc2-04d1-4334-a0cf-a5e71a341649 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:50.963522 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e5a64fc2-04d1-4334-a0cf-a5e71a341649 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:50.964284 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e5a64fc2-04d1-4334-a0cf-a5e71a341649 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:50.964716 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e5a64fc2-04d1-4334-a0cf-a5e71a341649 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:51.113644 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e5a64fc2-04d1-4334-a0cf-a5e71a341649 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:51.129409 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e5a64fc2-04d1-4334-a0cf-a5e71a341649 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:51.132253 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e5a64fc2-04d1-4334-a0cf-a5e71a341649 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:51.134784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e5a64fc2-04d1-4334-a0cf-a5e71a341649 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.185211 Jul 20 08:30:51.138652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 275/544] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:50 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:30:51.248932 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-686cd2bd-f36d-4aed-a8ad-d6f6a5fa3dca tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:51.249527 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-686cd2bd-f36d-4aed-a8ad-d6f6a5fa3dca tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:51.255627 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-686cd2bd-f36d-4aed-a8ad-d6f6a5fa3dca tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:51.256071 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-686cd2bd-f36d-4aed-a8ad-d6f6a5fa3dca tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:51.256925 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-686cd2bd-f36d-4aed-a8ad-d6f6a5fa3dca tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:51.257359 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-686cd2bd-f36d-4aed-a8ad-d6f6a5fa3dca tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:51.414725 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-686cd2bd-f36d-4aed-a8ad-d6f6a5fa3dca tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:51.418754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-6f0f9de7-bd2f-45a9-98bc-6aa2f68b81eb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:51.419362 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-6f0f9de7-bd2f-45a9-98bc-6aa2f68b81eb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:51.422400 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-686cd2bd-f36d-4aed-a8ad-d6f6a5fa3dca tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.177660 Jul 20 08:30:51.429295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 270/545] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:51 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:51.429517 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6f0f9de7-bd2f-45a9-98bc-6aa2f68b81eb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:51.429517 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6f0f9de7-bd2f-45a9-98bc-6aa2f68b81eb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:51.429517 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6f0f9de7-bd2f-45a9-98bc-6aa2f68b81eb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:51.429517 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6f0f9de7-bd2f-45a9-98bc-6aa2f68b81eb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:51.571284 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-6f0f9de7-bd2f-45a9-98bc-6aa2f68b81eb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:51.578913 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-6f0f9de7-bd2f-45a9-98bc-6aa2f68b81eb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.164325 Jul 20 08:30:51.588328 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 276/546] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:51 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:51.749103 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8e5f2a42-815f-4184-9036-0c951fa7f571 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:51.749705 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8e5f2a42-815f-4184-9036-0c951fa7f571 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:51.751594 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:30:51.756983 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8e5f2a42-815f-4184-9036-0c951fa7f571 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:51.757476 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8e5f2a42-815f-4184-9036-0c951fa7f571 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:51.758589 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8e5f2a42-815f-4184-9036-0c951fa7f571 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:51.758971 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8e5f2a42-815f-4184-9036-0c951fa7f571 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:51.837715 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8e5f2a42-815f-4184-9036-0c951fa7f571 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:51.845604 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8e5f2a42-815f-4184-9036-0c951fa7f571 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1137 microversion: 2.1 time: 0.100351 Jul 20 08:30:51.857395 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 271/547] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:51 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1137 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:51.892163 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a73f6b3e-9378-4c3d-b042-30e94dc1dc15 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39f23770-1802-4711-a880-97cedc3327ba"}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:30:51.893312 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a73f6b3e-9378-4c3d-b042-30e94dc1dc15 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:51.900370 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a73f6b3e-9378-4c3d-b042-30e94dc1dc15 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:51.900880 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a73f6b3e-9378-4c3d-b042-30e94dc1dc15 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:51.901669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a73f6b3e-9378-4c3d-b042-30e94dc1dc15 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:51.902099 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a73f6b3e-9378-4c3d-b042-30e94dc1dc15 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:52.154158 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-b2554e5f-468c-4989-9692-d9b0160507e3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:52.154784 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-b2554e5f-468c-4989-9692-d9b0160507e3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:52.161045 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b2554e5f-468c-4989-9692-d9b0160507e3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:52.161486 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b2554e5f-468c-4989-9692-d9b0160507e3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:52.162250 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b2554e5f-468c-4989-9692-d9b0160507e3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:52.162704 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b2554e5f-468c-4989-9692-d9b0160507e3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:52.305126 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b2554e5f-468c-4989-9692-d9b0160507e3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:52.313016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b2554e5f-468c-4989-9692-d9b0160507e3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:52.314514 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b2554e5f-468c-4989-9692-d9b0160507e3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:52.315734 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-b2554e5f-468c-4989-9692-d9b0160507e3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.165540 Jul 20 08:30:52.316283 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 272/548] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:52 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:30:52.440293 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e5def93c-8de5-4cf5-8d7d-14bb4adde2b3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:52.440894 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e5def93c-8de5-4cf5-8d7d-14bb4adde2b3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:52.449005 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e5def93c-8de5-4cf5-8d7d-14bb4adde2b3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:52.449576 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e5def93c-8de5-4cf5-8d7d-14bb4adde2b3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:52.450446 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e5def93c-8de5-4cf5-8d7d-14bb4adde2b3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:52.450930 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e5def93c-8de5-4cf5-8d7d-14bb4adde2b3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:52.607087 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e5def93c-8de5-4cf5-8d7d-14bb4adde2b3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:52.615066 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e5def93c-8de5-4cf5-8d7d-14bb4adde2b3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.178704 Jul 20 08:30:52.615672 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 273/549] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:52 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:52.620867 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8ebb93d2-4c9d-4b22-986e-182d492d5bf6 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:52.621466 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8ebb93d2-4c9d-4b22-986e-182d492d5bf6 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:52.627626 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8ebb93d2-4c9d-4b22-986e-182d492d5bf6 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:52.628072 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8ebb93d2-4c9d-4b22-986e-182d492d5bf6 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:52.628850 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8ebb93d2-4c9d-4b22-986e-182d492d5bf6 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:52.629283 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8ebb93d2-4c9d-4b22-986e-182d492d5bf6 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:52.774477 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8ebb93d2-4c9d-4b22-986e-182d492d5bf6 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:52.781933 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8ebb93d2-4c9d-4b22-986e-182d492d5bf6 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.164772 Jul 20 08:30:52.782486 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 274/550] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:52 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:52.864634 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9d3c981f-4b15-4529-b038-e586421384d9 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:52.865180 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9d3c981f-4b15-4529-b038-e586421384d9 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:52.871819 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9d3c981f-4b15-4529-b038-e586421384d9 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:52.872260 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9d3c981f-4b15-4529-b038-e586421384d9 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:52.873015 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9d3c981f-4b15-4529-b038-e586421384d9 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:52.873443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9d3c981f-4b15-4529-b038-e586421384d9 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:52.937200 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9d3c981f-4b15-4529-b038-e586421384d9 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:52.945001 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9d3c981f-4b15-4529-b038-e586421384d9 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1137 microversion: 2.1 time: 0.084192 Jul 20 08:30:52.945581 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 275/551] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:52 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1137 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:53.334625 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-b80a9d27-75b9-44d4-a4b9-46d259855d0e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:53.335955 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-b80a9d27-75b9-44d4-a4b9-46d259855d0e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:53.342304 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b80a9d27-75b9-44d4-a4b9-46d259855d0e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:53.342788 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b80a9d27-75b9-44d4-a4b9-46d259855d0e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:53.343549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b80a9d27-75b9-44d4-a4b9-46d259855d0e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:53.343978 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b80a9d27-75b9-44d4-a4b9-46d259855d0e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:53.480118 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b80a9d27-75b9-44d4-a4b9-46d259855d0e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:53.490296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b80a9d27-75b9-44d4-a4b9-46d259855d0e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:53.492013 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b80a9d27-75b9-44d4-a4b9-46d259855d0e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:53.493466 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-b80a9d27-75b9-44d4-a4b9-46d259855d0e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.162772 Jul 20 08:30:53.494276 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 276/552] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:53 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:30:53.632708 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f3da7e63-c7c5-4383-82ed-12c6ac1f6616 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:53.633497 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f3da7e63-c7c5-4383-82ed-12c6ac1f6616 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:53.640412 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f3da7e63-c7c5-4383-82ed-12c6ac1f6616 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:53.640858 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f3da7e63-c7c5-4383-82ed-12c6ac1f6616 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:53.641635 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f3da7e63-c7c5-4383-82ed-12c6ac1f6616 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:53.642065 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f3da7e63-c7c5-4383-82ed-12c6ac1f6616 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:53.646312 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:30:53.820760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f3da7e63-c7c5-4383-82ed-12c6ac1f6616 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:53.829033 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f3da7e63-c7c5-4383-82ed-12c6ac1f6616 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.200237 Jul 20 08:30:53.829615 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 277/553] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:53 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:53.834056 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9e747cdf-2dab-446f-b1d8-1a63d7b31757 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:53.834744 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9e747cdf-2dab-446f-b1d8-1a63d7b31757 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:53.842451 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9e747cdf-2dab-446f-b1d8-1a63d7b31757 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:53.842926 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9e747cdf-2dab-446f-b1d8-1a63d7b31757 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:53.843699 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9e747cdf-2dab-446f-b1d8-1a63d7b31757 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:53.844203 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9e747cdf-2dab-446f-b1d8-1a63d7b31757 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:53.996718 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9e747cdf-2dab-446f-b1d8-1a63d7b31757 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:54.004506 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9e747cdf-2dab-446f-b1d8-1a63d7b31757 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.173936 Jul 20 08:30:54.005344 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 278/554] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:53 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:54.011874 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-50bbe9ea-39e6-4273-9897-3e23441569c7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:54.012473 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-50bbe9ea-39e6-4273-9897-3e23441569c7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:54.020063 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-50bbe9ea-39e6-4273-9897-3e23441569c7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:54.020508 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-50bbe9ea-39e6-4273-9897-3e23441569c7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:54.021280 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-50bbe9ea-39e6-4273-9897-3e23441569c7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:54.021711 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-50bbe9ea-39e6-4273-9897-3e23441569c7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:54.092334 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-50bbe9ea-39e6-4273-9897-3e23441569c7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:54.100381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-50bbe9ea-39e6-4273-9897-3e23441569c7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1137 microversion: 2.1 time: 0.093976 Jul 20 08:30:54.101007 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 279/555] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:54 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1137 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:54.514420 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-315ff9d8-435e-4bea-be7e-fce97ff74860 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:54.515209 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-315ff9d8-435e-4bea-be7e-fce97ff74860 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:54.521747 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-315ff9d8-435e-4bea-be7e-fce97ff74860 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:54.522225 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-315ff9d8-435e-4bea-be7e-fce97ff74860 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:54.523805 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-315ff9d8-435e-4bea-be7e-fce97ff74860 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:54.524315 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-315ff9d8-435e-4bea-be7e-fce97ff74860 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:54.660657 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-315ff9d8-435e-4bea-be7e-fce97ff74860 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:54.668660 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-315ff9d8-435e-4bea-be7e-fce97ff74860 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:54.670280 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-315ff9d8-435e-4bea-be7e-fce97ff74860 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:54.671348 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-315ff9d8-435e-4bea-be7e-fce97ff74860 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.161400 Jul 20 08:30:54.671908 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 280/556] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:54 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:30:54.845330 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c45d7238-c181-4633-a71b-cc7e200a6995 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:54.845932 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c45d7238-c181-4633-a71b-cc7e200a6995 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:54.852333 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c45d7238-c181-4633-a71b-cc7e200a6995 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:54.852782 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c45d7238-c181-4633-a71b-cc7e200a6995 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:54.853542 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c45d7238-c181-4633-a71b-cc7e200a6995 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:54.853982 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c45d7238-c181-4633-a71b-cc7e200a6995 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:55.002223 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c45d7238-c181-4633-a71b-cc7e200a6995 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:55.011402 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c45d7238-c181-4633-a71b-cc7e200a6995 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.169924 Jul 20 08:30:55.011990 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 281/557] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:54 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:55.023220 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e58c087f-ced8-4b14-a890-0fc07cda7326 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:55.023547 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e58c087f-ced8-4b14-a890-0fc07cda7326 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:55.029965 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e58c087f-ced8-4b14-a890-0fc07cda7326 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:55.030401 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e58c087f-ced8-4b14-a890-0fc07cda7326 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:55.031210 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e58c087f-ced8-4b14-a890-0fc07cda7326 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:55.031649 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e58c087f-ced8-4b14-a890-0fc07cda7326 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:55.178038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e58c087f-ced8-4b14-a890-0fc07cda7326 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:55.186665 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e58c087f-ced8-4b14-a890-0fc07cda7326 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.168154 Jul 20 08:30:55.187239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 282/558] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:55 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:55.191789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-50e88130-1fb8-40b1-9ad1-d92f896a741e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:55.192379 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-50e88130-1fb8-40b1-9ad1-d92f896a741e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:55.198249 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-50e88130-1fb8-40b1-9ad1-d92f896a741e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:55.198741 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-50e88130-1fb8-40b1-9ad1-d92f896a741e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:55.199498 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-50e88130-1fb8-40b1-9ad1-d92f896a741e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:55.199928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-50e88130-1fb8-40b1-9ad1-d92f896a741e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:55.261022 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-50e88130-1fb8-40b1-9ad1-d92f896a741e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:55.268471 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-50e88130-1fb8-40b1-9ad1-d92f896a741e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1137 microversion: 2.1 time: 0.080304 Jul 20 08:30:55.269027 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 283/559] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:55 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1137 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:55.690688 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-046ffce9-38b9-466e-a118-cfcf07f778d8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:55.691394 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-046ffce9-38b9-466e-a118-cfcf07f778d8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:55.697968 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-046ffce9-38b9-466e-a118-cfcf07f778d8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:55.698424 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-046ffce9-38b9-466e-a118-cfcf07f778d8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:55.699220 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-046ffce9-38b9-466e-a118-cfcf07f778d8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:55.699649 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-046ffce9-38b9-466e-a118-cfcf07f778d8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:55.830162 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-046ffce9-38b9-466e-a118-cfcf07f778d8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:55.838779 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-046ffce9-38b9-466e-a118-cfcf07f778d8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:55.840278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-046ffce9-38b9-466e-a118-cfcf07f778d8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:55.841424 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-046ffce9-38b9-466e-a118-cfcf07f778d8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.154775 Jul 20 08:30:55.841981 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 284/560] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:55 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:30:56.028562 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-2b907bad-3208-491e-9f70-619ba818f204 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:56.029208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-2b907bad-3208-491e-9f70-619ba818f204 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:56.035270 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2b907bad-3208-491e-9f70-619ba818f204 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:56.035707 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2b907bad-3208-491e-9f70-619ba818f204 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:56.036458 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2b907bad-3208-491e-9f70-619ba818f204 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:56.036886 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2b907bad-3208-491e-9f70-619ba818f204 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:56.177919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-2b907bad-3208-491e-9f70-619ba818f204 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:56.185818 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-2b907bad-3208-491e-9f70-619ba818f204 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.161077 Jul 20 08:30:56.186414 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 285/561] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:56 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:56.203594 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d9fcfb3c-cc87-456b-8224-c8f49eaa14af tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:56.204204 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d9fcfb3c-cc87-456b-8224-c8f49eaa14af tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:56.210379 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d9fcfb3c-cc87-456b-8224-c8f49eaa14af tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:56.211418 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d9fcfb3c-cc87-456b-8224-c8f49eaa14af tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:56.212199 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d9fcfb3c-cc87-456b-8224-c8f49eaa14af tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:56.212637 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d9fcfb3c-cc87-456b-8224-c8f49eaa14af tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:56.345893 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d9fcfb3c-cc87-456b-8224-c8f49eaa14af tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:56.353569 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d9fcfb3c-cc87-456b-8224-c8f49eaa14af tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.153781 Jul 20 08:30:56.354150 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 286/562] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:56 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:56.358683 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-b5e551df-330e-4ca8-a9c8-e3ecd46b0176 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:56.359282 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-b5e551df-330e-4ca8-a9c8-e3ecd46b0176 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:56.365365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b5e551df-330e-4ca8-a9c8-e3ecd46b0176 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:56.365813 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b5e551df-330e-4ca8-a9c8-e3ecd46b0176 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:56.366605 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b5e551df-330e-4ca8-a9c8-e3ecd46b0176 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:56.367565 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b5e551df-330e-4ca8-a9c8-e3ecd46b0176 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:56.439086 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b5e551df-330e-4ca8-a9c8-e3ecd46b0176 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:56.447322 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-b5e551df-330e-4ca8-a9c8-e3ecd46b0176 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1137 microversion: 2.1 time: 0.092129 Jul 20 08:30:56.447903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 287/563] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:56 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1137 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:56.860288 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-949260b6-41de-4269-bf63-c89477ca564a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:56.861076 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-949260b6-41de-4269-bf63-c89477ca564a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:56.868386 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-949260b6-41de-4269-bf63-c89477ca564a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:56.868826 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-949260b6-41de-4269-bf63-c89477ca564a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:56.869587 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-949260b6-41de-4269-bf63-c89477ca564a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:56.870016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-949260b6-41de-4269-bf63-c89477ca564a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:57.000367 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-949260b6-41de-4269-bf63-c89477ca564a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:57.010311 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-949260b6-41de-4269-bf63-c89477ca564a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:57.012268 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-949260b6-41de-4269-bf63-c89477ca564a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:57.013839 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-949260b6-41de-4269-bf63-c89477ca564a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.157385 Jul 20 08:30:57.014408 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 288/564] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:56 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:30:57.071995 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9ebed55a-3176-40b4-9462-50377fd330a0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:57.072614 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9ebed55a-3176-40b4-9462-50377fd330a0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:57.078980 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9ebed55a-3176-40b4-9462-50377fd330a0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:57.079435 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9ebed55a-3176-40b4-9462-50377fd330a0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:57.080219 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9ebed55a-3176-40b4-9462-50377fd330a0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:57.080647 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9ebed55a-3176-40b4-9462-50377fd330a0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:57.105647 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9ebed55a-3176-40b4-9462-50377fd330a0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc/ips" status: 200 len: 146 microversion: 2.1 time: 0.037828 Jul 20 08:30:57.106238 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 289/565] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Jul 20 08:30:57 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:30:57.203161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4caf3378-75c9-4117-89a9-fb3912028d32 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:57.203700 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4caf3378-75c9-4117-89a9-fb3912028d32 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:57.209828 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4caf3378-75c9-4117-89a9-fb3912028d32 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:57.210280 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4caf3378-75c9-4117-89a9-fb3912028d32 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:57.211704 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4caf3378-75c9-4117-89a9-fb3912028d32 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:57.212134 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4caf3378-75c9-4117-89a9-fb3912028d32 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:57.345661 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4caf3378-75c9-4117-89a9-fb3912028d32 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:57.354221 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4caf3378-75c9-4117-89a9-fb3912028d32 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.154930 Jul 20 08:30:57.354832 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 290/566] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:57 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:57.370519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-358954e9-a266-4a2b-9597-1b37f23dd995 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:57.371152 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-358954e9-a266-4a2b-9597-1b37f23dd995 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:57.377240 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-358954e9-a266-4a2b-9597-1b37f23dd995 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:57.377687 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-358954e9-a266-4a2b-9597-1b37f23dd995 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:57.378455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-358954e9-a266-4a2b-9597-1b37f23dd995 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:57.378920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-358954e9-a266-4a2b-9597-1b37f23dd995 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:57.513596 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-358954e9-a266-4a2b-9597-1b37f23dd995 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:57.521047 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-358954e9-a266-4a2b-9597-1b37f23dd995 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.154368 Jul 20 08:30:57.521607 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 291/567] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:57 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:57.526818 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c88e805b-13ce-4f59-a298-d058c378ccea tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:57.527418 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c88e805b-13ce-4f59-a298-d058c378ccea tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:57.533127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c88e805b-13ce-4f59-a298-d058c378ccea tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:57.533566 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c88e805b-13ce-4f59-a298-d058c378ccea tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:57.534390 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c88e805b-13ce-4f59-a298-d058c378ccea tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:57.534849 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c88e805b-13ce-4f59-a298-d058c378ccea tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:57.595685 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c88e805b-13ce-4f59-a298-d058c378ccea tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:57.603821 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c88e805b-13ce-4f59-a298-d058c378ccea tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1137 microversion: 2.1 time: 0.081254 Jul 20 08:30:57.604378 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 292/568] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:57 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1137 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:58.032505 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6f6fe90b-4ff1-4d1c-bfd4-5bc6ddcbe2a4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:58.033127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6f6fe90b-4ff1-4d1c-bfd4-5bc6ddcbe2a4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:58.039887 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6f6fe90b-4ff1-4d1c-bfd4-5bc6ddcbe2a4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:58.040334 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6f6fe90b-4ff1-4d1c-bfd4-5bc6ddcbe2a4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:58.041128 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6f6fe90b-4ff1-4d1c-bfd4-5bc6ddcbe2a4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:58.041535 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6f6fe90b-4ff1-4d1c-bfd4-5bc6ddcbe2a4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:58.176613 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6f6fe90b-4ff1-4d1c-bfd4-5bc6ddcbe2a4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:58.185183 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6f6fe90b-4ff1-4d1c-bfd4-5bc6ddcbe2a4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:58.186709 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6f6fe90b-4ff1-4d1c-bfd4-5bc6ddcbe2a4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:58.187857 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6f6fe90b-4ff1-4d1c-bfd4-5bc6ddcbe2a4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.159285 Jul 20 08:30:58.188407 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 293/569] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:58 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:30:58.372022 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-512e66da-7c52-4d74-9802-a45c01bcb841 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:58.372626 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-512e66da-7c52-4d74-9802-a45c01bcb841 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:58.378650 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-512e66da-7c52-4d74-9802-a45c01bcb841 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:58.379101 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-512e66da-7c52-4d74-9802-a45c01bcb841 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:58.379862 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-512e66da-7c52-4d74-9802-a45c01bcb841 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:58.380298 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-512e66da-7c52-4d74-9802-a45c01bcb841 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:58.384554 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:30:58.522471 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-512e66da-7c52-4d74-9802-a45c01bcb841 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:58.530673 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-512e66da-7c52-4d74-9802-a45c01bcb841 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.162424 Jul 20 08:30:58.531257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 294/570] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:58 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:58.538195 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4a5e733f-b224-4fcc-956c-d8aecaff4031 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:58.539500 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4a5e733f-b224-4fcc-956c-d8aecaff4031 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:58.545681 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4a5e733f-b224-4fcc-956c-d8aecaff4031 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:58.546148 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4a5e733f-b224-4fcc-956c-d8aecaff4031 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:58.546967 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4a5e733f-b224-4fcc-956c-d8aecaff4031 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:58.547402 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4a5e733f-b224-4fcc-956c-d8aecaff4031 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:58.677801 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4a5e733f-b224-4fcc-956c-d8aecaff4031 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:58.685196 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4a5e733f-b224-4fcc-956c-d8aecaff4031 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.150677 Jul 20 08:30:58.685752 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 295/571] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:58 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:58.690067 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-775bce07-5b87-4b09-b64e-f78f17ed8d4b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:58.690676 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-775bce07-5b87-4b09-b64e-f78f17ed8d4b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:58.696410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-775bce07-5b87-4b09-b64e-f78f17ed8d4b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:58.696852 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-775bce07-5b87-4b09-b64e-f78f17ed8d4b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:58.697602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-775bce07-5b87-4b09-b64e-f78f17ed8d4b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:58.698024 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-775bce07-5b87-4b09-b64e-f78f17ed8d4b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:58.761393 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-775bce07-5b87-4b09-b64e-f78f17ed8d4b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:58.768885 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-775bce07-5b87-4b09-b64e-f78f17ed8d4b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1137 microversion: 2.1 time: 0.082201 Jul 20 08:30:58.769447 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 296/572] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:58 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1137 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:59.205369 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-db522640-1dcd-4680-b2e0-beabc75d6375 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:59.206030 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-db522640-1dcd-4680-b2e0-beabc75d6375 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:59.213015 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-db522640-1dcd-4680-b2e0-beabc75d6375 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:59.213455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-db522640-1dcd-4680-b2e0-beabc75d6375 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:59.214209 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-db522640-1dcd-4680-b2e0-beabc75d6375 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:59.214661 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-db522640-1dcd-4680-b2e0-beabc75d6375 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:59.342940 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-db522640-1dcd-4680-b2e0-beabc75d6375 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:59.350817 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-db522640-1dcd-4680-b2e0-beabc75d6375 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:59.352573 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-db522640-1dcd-4680-b2e0-beabc75d6375 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:59.353730 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-db522640-1dcd-4680-b2e0-beabc75d6375 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.152284 Jul 20 08:30:59.354292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 297/573] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:30:59 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:30:59.548995 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-af50034a-1108-4100-9ac9-a15ebbd4f693 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:59.549602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-af50034a-1108-4100-9ac9-a15ebbd4f693 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:59.555789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-af50034a-1108-4100-9ac9-a15ebbd4f693 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:59.556237 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-af50034a-1108-4100-9ac9-a15ebbd4f693 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:59.557003 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-af50034a-1108-4100-9ac9-a15ebbd4f693 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:59.557440 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-af50034a-1108-4100-9ac9-a15ebbd4f693 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:59.707495 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-af50034a-1108-4100-9ac9-a15ebbd4f693 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:59.716573 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-af50034a-1108-4100-9ac9-a15ebbd4f693 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.171342 Jul 20 08:30:59.717176 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 298/574] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:59 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:30:59.721833 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5300de98-e6d1-4cde-a83e-9dfeb90cc57a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:59.722442 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5300de98-e6d1-4cde-a83e-9dfeb90cc57a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:59.728921 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5300de98-e6d1-4cde-a83e-9dfeb90cc57a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:59.729370 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5300de98-e6d1-4cde-a83e-9dfeb90cc57a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:59.730153 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5300de98-e6d1-4cde-a83e-9dfeb90cc57a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:59.730621 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5300de98-e6d1-4cde-a83e-9dfeb90cc57a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:59.874930 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5300de98-e6d1-4cde-a83e-9dfeb90cc57a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:59.883773 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5300de98-e6d1-4cde-a83e-9dfeb90cc57a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.164672 Jul 20 08:30:59.884350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 299/575] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:59 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:30:59.889414 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-7aba7d04-7b88-4f5c-aff1-5fea3d149076 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:30:59.890016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-7aba7d04-7b88-4f5c-aff1-5fea3d149076 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:30:59.896232 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7aba7d04-7b88-4f5c-aff1-5fea3d149076 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:59.896682 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7aba7d04-7b88-4f5c-aff1-5fea3d149076 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:59.897456 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7aba7d04-7b88-4f5c-aff1-5fea3d149076 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:30:59.897891 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7aba7d04-7b88-4f5c-aff1-5fea3d149076 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:30:59.968236 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-7aba7d04-7b88-4f5c-aff1-5fea3d149076 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:30:59.975761 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-7aba7d04-7b88-4f5c-aff1-5fea3d149076 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1137 microversion: 2.1 time: 0.090447 Jul 20 08:30:59.976333 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 300/576] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:30:59 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:00.115226 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5860cf0a-9802-4b08-9482-5f7e1670eb7e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b32370d-01d8-4167-b35e-cc292d59beb9"}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:00.116370 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5860cf0a-9802-4b08-9482-5f7e1670eb7e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:00.123633 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5860cf0a-9802-4b08-9482-5f7e1670eb7e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:00.124078 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5860cf0a-9802-4b08-9482-5f7e1670eb7e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:00.124843 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5860cf0a-9802-4b08-9482-5f7e1670eb7e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:00.125299 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5860cf0a-9802-4b08-9482-5f7e1670eb7e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:00.417570 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=2 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:00.439044 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=6 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:00.729219 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=2 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:01.200390 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5860cf0a-9802-4b08-9482-5f7e1670eb7e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "POST /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.088697 Jul 20 08:31:01.201753 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 301/577] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Jul 20 08:31:00 2022] POST /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc/os-volume_attachments => generated 194 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:31:01.239952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-093c0cc6-7163-4e7c-acbd-269a874d47d4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:01.240589 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-093c0cc6-7163-4e7c-acbd-269a874d47d4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:01.250559 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-093c0cc6-7163-4e7c-acbd-269a874d47d4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:01.251056 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-093c0cc6-7163-4e7c-acbd-269a874d47d4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:01.251860 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-093c0cc6-7163-4e7c-acbd-269a874d47d4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:01.252905 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-093c0cc6-7163-4e7c-acbd-269a874d47d4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:01.262701 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a73f6b3e-9378-4c3d-b042-30e94dc1dc15 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "POST /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.374486 Jul 20 08:31:01.267498 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 277/578] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Jul 20 08:30:51 2022] POST /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650/os-volume_attachments => generated 194 bytes in 9380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:31:01.282152 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a56e828c-223f-47cb-8c2b-3a5f80a3894b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:01.282905 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a56e828c-223f-47cb-8c2b-3a5f80a3894b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:01.299149 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a56e828c-223f-47cb-8c2b-3a5f80a3894b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:01.299828 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a56e828c-223f-47cb-8c2b-3a5f80a3894b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:01.300784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a56e828c-223f-47cb-8c2b-3a5f80a3894b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:01.301640 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a56e828c-223f-47cb-8c2b-3a5f80a3894b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:01.567196 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-093c0cc6-7163-4e7c-acbd-269a874d47d4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:01.580194 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-093c0cc6-7163-4e7c-acbd-269a874d47d4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:01.582060 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-093c0cc6-7163-4e7c-acbd-269a874d47d4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:01.583271 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-093c0cc6-7163-4e7c-acbd-269a874d47d4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.380065 Jul 20 08:31:01.583972 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 302/579] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:01 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:01.589282 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3171b6c7-f081-4e01-a45f-60a0a83288ab tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:01.590302 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3171b6c7-f081-4e01-a45f-60a0a83288ab tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:01.596732 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3171b6c7-f081-4e01-a45f-60a0a83288ab tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:01.597364 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3171b6c7-f081-4e01-a45f-60a0a83288ab tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:01.598180 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3171b6c7-f081-4e01-a45f-60a0a83288ab tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:01.598553 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3171b6c7-f081-4e01-a45f-60a0a83288ab tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:01.684036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a56e828c-223f-47cb-8c2b-3a5f80a3894b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:01.694837 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a56e828c-223f-47cb-8c2b-3a5f80a3894b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.426171 Jul 20 08:31:01.696417 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 278/580] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:01 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:01.701074 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-81b65eb5-ada0-49c6-8382-cde76fbbe156 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:01.701682 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-81b65eb5-ada0-49c6-8382-cde76fbbe156 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:01.707849 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-81b65eb5-ada0-49c6-8382-cde76fbbe156 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:01.708351 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-81b65eb5-ada0-49c6-8382-cde76fbbe156 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:01.709123 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-81b65eb5-ada0-49c6-8382-cde76fbbe156 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:01.709643 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-81b65eb5-ada0-49c6-8382-cde76fbbe156 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:01.777270 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-81b65eb5-ada0-49c6-8382-cde76fbbe156 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:01.785287 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-81b65eb5-ada0-49c6-8382-cde76fbbe156 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1185 microversion: 2.1 time: 0.087716 Jul 20 08:31:01.786162 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 279/581] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:01 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:01.801310 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-9e031494-1f98-4017-83e3-de0efccabd5a req-ec483f93-45b3-474d-bd6f-aabc4bfbe230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a437f068-8b36-411d-ab25-a00ec30b71de", "tag": "26b6ab63-8e74-43dc-82a1-e3067592fa61"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:01.811509 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-9e031494-1f98-4017-83e3-de0efccabd5a req-ec483f93-45b3-474d-bd6f-aabc4bfbe230 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:01.812184 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-9e031494-1f98-4017-83e3-de0efccabd5a req-ec483f93-45b3-474d-bd6f-aabc4bfbe230 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:01.815856 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3171b6c7-f081-4e01-a45f-60a0a83288ab tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:01.824916 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-9e031494-1f98-4017-83e3-de0efccabd5a req-ec483f93-45b3-474d-bd6f-aabc4bfbe230 service nova] Creating event network-changed:26b6ab63-8e74-43dc-82a1-e3067592fa61 for instance a437f068-8b36-411d-ab25-a00ec30b71de on hv-cinder-82308 Jul 20 08:31:01.825159 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3171b6c7-f081-4e01-a45f-60a0a83288ab tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.239897 Jul 20 08:31:01.825654 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 303/582] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:01 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:01.829936 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-9e031494-1f98-4017-83e3-de0efccabd5a req-ec483f93-45b3-474d-bd6f-aabc4bfbe230 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033238 Jul 20 08:31:01.830608 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 280/583] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:31:02.601832 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-97b0a0fa-45d3-4ab8-81b3-55ccc897b896 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:02.602560 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-97b0a0fa-45d3-4ab8-81b3-55ccc897b896 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:02.609093 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-97b0a0fa-45d3-4ab8-81b3-55ccc897b896 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:02.609548 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-97b0a0fa-45d3-4ab8-81b3-55ccc897b896 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:02.610305 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-97b0a0fa-45d3-4ab8-81b3-55ccc897b896 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:02.610811 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-97b0a0fa-45d3-4ab8-81b3-55ccc897b896 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:02.713910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7dc56669-d186-43a9-9c8b-641f205267ed tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:02.715085 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-7dc56669-d186-43a9-9c8b-641f205267ed tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:02.721010 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7dc56669-d186-43a9-9c8b-641f205267ed tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:02.721555 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7dc56669-d186-43a9-9c8b-641f205267ed tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:02.722423 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7dc56669-d186-43a9-9c8b-641f205267ed tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:02.722949 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7dc56669-d186-43a9-9c8b-641f205267ed tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:02.747341 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-97b0a0fa-45d3-4ab8-81b3-55ccc897b896 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:02.755496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-97b0a0fa-45d3-4ab8-81b3-55ccc897b896 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:02.756980 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-97b0a0fa-45d3-4ab8-81b3-55ccc897b896 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:02.758662 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-97b0a0fa-45d3-4ab8-81b3-55ccc897b896 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.160991 Jul 20 08:31:02.759263 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 304/584] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:02 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:02.803088 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f7ea8774-7874-4405-9821-dc5119c1485f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:02.803724 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f7ea8774-7874-4405-9821-dc5119c1485f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:02.810632 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f7ea8774-7874-4405-9821-dc5119c1485f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:02.811194 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f7ea8774-7874-4405-9821-dc5119c1485f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:02.811833 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f7ea8774-7874-4405-9821-dc5119c1485f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:02.812258 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f7ea8774-7874-4405-9821-dc5119c1485f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:02.864591 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-7dc56669-d186-43a9-9c8b-641f205267ed tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:02.873171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-7dc56669-d186-43a9-9c8b-641f205267ed tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.163968 Jul 20 08:31:02.873843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 281/585] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:02 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:02.874925 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f7ea8774-7874-4405-9821-dc5119c1485f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:02.878345 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-23ce5c05-0bac-41d1-b188-379ca34d6c56 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:02.879160 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-23ce5c05-0bac-41d1-b188-379ca34d6c56 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:02.882722 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f7ea8774-7874-4405-9821-dc5119c1485f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1193 microversion: 2.1 time: 0.083373 Jul 20 08:31:02.883553 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 305/586] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:02 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:02.885272 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-23ce5c05-0bac-41d1-b188-379ca34d6c56 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:02.885722 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-23ce5c05-0bac-41d1-b188-379ca34d6c56 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:02.886491 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-23ce5c05-0bac-41d1-b188-379ca34d6c56 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:02.886957 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-23ce5c05-0bac-41d1-b188-379ca34d6c56 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:02.904800 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:03.016658 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-23ce5c05-0bac-41d1-b188-379ca34d6c56 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:03.025619 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-23ce5c05-0bac-41d1-b188-379ca34d6c56 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.150462 Jul 20 08:31:03.025963 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 282/587] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:02 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:03.778226 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-fd74c2dc-3b66-4ad1-b708-f3cf572b895f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:03.778966 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-fd74c2dc-3b66-4ad1-b708-f3cf572b895f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:03.785013 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fd74c2dc-3b66-4ad1-b708-f3cf572b895f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:03.785453 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fd74c2dc-3b66-4ad1-b708-f3cf572b895f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:03.786219 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fd74c2dc-3b66-4ad1-b708-f3cf572b895f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:03.786670 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fd74c2dc-3b66-4ad1-b708-f3cf572b895f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:03.890487 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-99f012b0-984d-4876-8f20-2eeee66a502a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:03.891124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-99f012b0-984d-4876-8f20-2eeee66a502a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:03.897690 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-99f012b0-984d-4876-8f20-2eeee66a502a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:03.898479 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-99f012b0-984d-4876-8f20-2eeee66a502a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:03.899493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-99f012b0-984d-4876-8f20-2eeee66a502a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:03.899972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-99f012b0-984d-4876-8f20-2eeee66a502a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:03.955578 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fd74c2dc-3b66-4ad1-b708-f3cf572b895f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:03.963772 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fd74c2dc-3b66-4ad1-b708-f3cf572b895f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:03.965367 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fd74c2dc-3b66-4ad1-b708-f3cf572b895f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:03.967030 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-fd74c2dc-3b66-4ad1-b708-f3cf572b895f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1746 microversion: 2.20 time: 0.193941 Jul 20 08:31:03.967586 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 306/588] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:03 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1746 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:03.972156 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4b661e5a-2e76-44de-9363-40258e0cc385 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:03.972785 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4b661e5a-2e76-44de-9363-40258e0cc385 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:03.979992 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4b661e5a-2e76-44de-9363-40258e0cc385 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:03.980716 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4b661e5a-2e76-44de-9363-40258e0cc385 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:03.981151 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4b661e5a-2e76-44de-9363-40258e0cc385 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:03.981568 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4b661e5a-2e76-44de-9363-40258e0cc385 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:04.042620 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-99f012b0-984d-4876-8f20-2eeee66a502a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:04.045555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4b661e5a-2e76-44de-9363-40258e0cc385 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:04.050330 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-99f012b0-984d-4876-8f20-2eeee66a502a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1266 microversion: 2.1 time: 0.163776 Jul 20 08:31:04.050927 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 283/589] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:03 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:04.053157 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4b661e5a-2e76-44de-9363-40258e0cc385 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1203 microversion: 2.1 time: 0.084603 Jul 20 08:31:04.053709 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 307/590] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:03 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1203 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:04.056508 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-12754457-53f3-46c2-8f76-8d6d38fbdf6e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:04.057108 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-12754457-53f3-46c2-8f76-8d6d38fbdf6e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:04.063174 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-12754457-53f3-46c2-8f76-8d6d38fbdf6e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:04.063620 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-12754457-53f3-46c2-8f76-8d6d38fbdf6e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:04.064379 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-12754457-53f3-46c2-8f76-8d6d38fbdf6e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:04.064806 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-12754457-53f3-46c2-8f76-8d6d38fbdf6e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:04.197275 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-12754457-53f3-46c2-8f76-8d6d38fbdf6e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:04.204668 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-12754457-53f3-46c2-8f76-8d6d38fbdf6e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.152545 Jul 20 08:31:04.205161 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 284/591] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:04 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:04.987838 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d8259d82-717d-4d40-b9f9-07e0cb2a047f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:04.989154 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d8259d82-717d-4d40-b9f9-07e0cb2a047f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:04.996147 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d8259d82-717d-4d40-b9f9-07e0cb2a047f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:04.996595 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d8259d82-717d-4d40-b9f9-07e0cb2a047f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:04.997372 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d8259d82-717d-4d40-b9f9-07e0cb2a047f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:04.997842 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d8259d82-717d-4d40-b9f9-07e0cb2a047f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:05.068743 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9bfcffc4-d81c-4676-93be-bd016d7e3bd6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:05.069351 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9bfcffc4-d81c-4676-93be-bd016d7e3bd6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:05.076998 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9bfcffc4-d81c-4676-93be-bd016d7e3bd6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:05.077447 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9bfcffc4-d81c-4676-93be-bd016d7e3bd6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:05.078217 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9bfcffc4-d81c-4676-93be-bd016d7e3bd6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:05.078670 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9bfcffc4-d81c-4676-93be-bd016d7e3bd6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:05.217077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9bfcffc4-d81c-4676-93be-bd016d7e3bd6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:05.225382 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9bfcffc4-d81c-4676-93be-bd016d7e3bd6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1452 microversion: 2.1 time: 0.161833 Jul 20 08:31:05.225958 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 285/592] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:05 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:05.230655 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-17702ae8-4bf3-4564-814c-086286869339 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:05.231474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-17702ae8-4bf3-4564-814c-086286869339 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:05.237950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-17702ae8-4bf3-4564-814c-086286869339 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:05.238356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-17702ae8-4bf3-4564-814c-086286869339 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:05.239207 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-17702ae8-4bf3-4564-814c-086286869339 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:05.239640 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-17702ae8-4bf3-4564-814c-086286869339 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:05.270772 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d8259d82-717d-4d40-b9f9-07e0cb2a047f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:05.280450 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d8259d82-717d-4d40-b9f9-07e0cb2a047f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:05.282037 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d8259d82-717d-4d40-b9f9-07e0cb2a047f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:05.283323 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d8259d82-717d-4d40-b9f9-07e0cb2a047f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1746 microversion: 2.20 time: 0.299501 Jul 20 08:31:05.284297 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 308/593] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:04 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1746 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:05.289426 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5d35fefa-12cc-4277-add4-6b8f10aaa106 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:05.290543 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5d35fefa-12cc-4277-add4-6b8f10aaa106 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:05.297282 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5d35fefa-12cc-4277-add4-6b8f10aaa106 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:05.297983 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5d35fefa-12cc-4277-add4-6b8f10aaa106 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:05.299791 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5d35fefa-12cc-4277-add4-6b8f10aaa106 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:05.300389 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5d35fefa-12cc-4277-add4-6b8f10aaa106 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:05.314439 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-17702ae8-4bf3-4564-814c-086286869339 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:05.323312 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-17702ae8-4bf3-4564-814c-086286869339 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1203 microversion: 2.1 time: 0.096328 Jul 20 08:31:05.323906 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 286/594] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:05 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1203 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:05.327154 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:05.328393 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b79fb167-aec6-45b7-964f-3bb84465d011 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:05.328984 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b79fb167-aec6-45b7-964f-3bb84465d011 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:05.337984 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b79fb167-aec6-45b7-964f-3bb84465d011 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:05.338520 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b79fb167-aec6-45b7-964f-3bb84465d011 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:05.339447 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b79fb167-aec6-45b7-964f-3bb84465d011 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:05.339949 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b79fb167-aec6-45b7-964f-3bb84465d011 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:05.475414 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b79fb167-aec6-45b7-964f-3bb84465d011 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:05.484304 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b79fb167-aec6-45b7-964f-3bb84465d011 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1452 microversion: 2.1 time: 0.159344 Jul 20 08:31:05.484999 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 287/595] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:05 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:05.610829 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5d35fefa-12cc-4277-add4-6b8f10aaa106 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:05.621391 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5d35fefa-12cc-4277-add4-6b8f10aaa106 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.335815 Jul 20 08:31:05.622425 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 309/596] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:05 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:06.301898 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-70652435-c7cc-4a9e-ad49-b51f0f5311bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:06.302518 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-70652435-c7cc-4a9e-ad49-b51f0f5311bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:06.309051 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-70652435-c7cc-4a9e-ad49-b51f0f5311bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:06.309492 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-70652435-c7cc-4a9e-ad49-b51f0f5311bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:06.310256 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-70652435-c7cc-4a9e-ad49-b51f0f5311bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:06.310709 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-70652435-c7cc-4a9e-ad49-b51f0f5311bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:06.344373 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a0f4c37b-f370-4a5e-a21b-8d4b28bb7162 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:06.345009 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a0f4c37b-f370-4a5e-a21b-8d4b28bb7162 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:06.352586 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a0f4c37b-f370-4a5e-a21b-8d4b28bb7162 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:06.353036 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a0f4c37b-f370-4a5e-a21b-8d4b28bb7162 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:06.353817 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a0f4c37b-f370-4a5e-a21b-8d4b28bb7162 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:06.354252 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a0f4c37b-f370-4a5e-a21b-8d4b28bb7162 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:06.496035 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a0f4c37b-f370-4a5e-a21b-8d4b28bb7162 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:06.504374 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a0f4c37b-f370-4a5e-a21b-8d4b28bb7162 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1270 microversion: 2.1 time: 0.165720 Jul 20 08:31:06.504952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 310/597] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:06 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:06.537493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-70652435-c7cc-4a9e-ad49-b51f0f5311bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:06.545625 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-70652435-c7cc-4a9e-ad49-b51f0f5311bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:06.547285 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-70652435-c7cc-4a9e-ad49-b51f0f5311bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:06.548440 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-70652435-c7cc-4a9e-ad49-b51f0f5311bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1746 microversion: 2.20 time: 0.250503 Jul 20 08:31:06.549010 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 288/598] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:06 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1746 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:06.639549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a68e0e03-ad5c-4960-95f4-6780d7616f63 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:06.640204 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a68e0e03-ad5c-4960-95f4-6780d7616f63 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:06.647206 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a68e0e03-ad5c-4960-95f4-6780d7616f63 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:06.647656 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a68e0e03-ad5c-4960-95f4-6780d7616f63 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:06.648994 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a68e0e03-ad5c-4960-95f4-6780d7616f63 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:06.649600 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a68e0e03-ad5c-4960-95f4-6780d7616f63 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:06.793777 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a68e0e03-ad5c-4960-95f4-6780d7616f63 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:06.803486 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a68e0e03-ad5c-4960-95f4-6780d7616f63 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.168074 Jul 20 08:31:06.805109 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 311/599] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:06 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:07.401562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-225633a1-c960-4427-941e-5849bba1b41d req-7a7eb627-d267-43f0-98b1-5c867b25e37b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15050cb9-f79e-4546-b875-1b4e338312fa", "tag": "91e7ab01-3fe6-490c-8584-7db55fc13380"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:07.410000 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-225633a1-c960-4427-941e-5849bba1b41d req-7a7eb627-d267-43f0-98b1-5c867b25e37b service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:07.410444 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-225633a1-c960-4427-941e-5849bba1b41d req-7a7eb627-d267-43f0-98b1-5c867b25e37b service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:07.422040 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-225633a1-c960-4427-941e-5849bba1b41d req-7a7eb627-d267-43f0-98b1-5c867b25e37b service nova] Creating event network-changed:91e7ab01-3fe6-490c-8584-7db55fc13380 for instance 15050cb9-f79e-4546-b875-1b4e338312fa on hv-cinder-82308 Jul 20 08:31:07.427067 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-225633a1-c960-4427-941e-5849bba1b41d req-7a7eb627-d267-43f0-98b1-5c867b25e37b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029319 Jul 20 08:31:07.427707 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 289/600] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:31:07.521258 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-b60d044d-bf87-44f3-a667-c8672de82c91 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:07.521879 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-b60d044d-bf87-44f3-a667-c8672de82c91 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:07.528965 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b60d044d-bf87-44f3-a667-c8672de82c91 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:07.529408 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b60d044d-bf87-44f3-a667-c8672de82c91 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:07.530170 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b60d044d-bf87-44f3-a667-c8672de82c91 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:07.530700 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b60d044d-bf87-44f3-a667-c8672de82c91 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:07.568053 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1a35a2c4-8b3b-4f44-a633-505e6d3202b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:07.569166 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1a35a2c4-8b3b-4f44-a633-505e6d3202b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:07.575817 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1a35a2c4-8b3b-4f44-a633-505e6d3202b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:07.576409 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1a35a2c4-8b3b-4f44-a633-505e6d3202b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:07.577303 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1a35a2c4-8b3b-4f44-a633-505e6d3202b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:07.577841 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1a35a2c4-8b3b-4f44-a633-505e6d3202b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:07.694155 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b60d044d-bf87-44f3-a667-c8672de82c91 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:07.705971 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-b60d044d-bf87-44f3-a667-c8672de82c91 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1270 microversion: 2.1 time: 0.187639 Jul 20 08:31:07.716473 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 312/601] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:07 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1270 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:07.736091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1a35a2c4-8b3b-4f44-a633-505e6d3202b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:07.744708 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1a35a2c4-8b3b-4f44-a633-505e6d3202b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:07.746217 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1a35a2c4-8b3b-4f44-a633-505e6d3202b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:07.747456 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1a35a2c4-8b3b-4f44-a633-505e6d3202b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1746 microversion: 2.20 time: 0.184007 Jul 20 08:31:07.748010 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 290/602] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:07 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1746 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:31:07.821619 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3185c869-15b6-452b-89e0-5de83846185e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:07.822228 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3185c869-15b6-452b-89e0-5de83846185e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:07.828937 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3185c869-15b6-452b-89e0-5de83846185e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:07.829386 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3185c869-15b6-452b-89e0-5de83846185e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:07.830169 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3185c869-15b6-452b-89e0-5de83846185e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:07.830624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3185c869-15b6-452b-89e0-5de83846185e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:07.966232 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3185c869-15b6-452b-89e0-5de83846185e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:07.974627 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3185c869-15b6-452b-89e0-5de83846185e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.156987 Jul 20 08:31:07.975111 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 313/603] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:07 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:08.724521 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-10b0677a-d7a9-4a22-81d2-2295dedf26f1 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:08.727335 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-10b0677a-d7a9-4a22-81d2-2295dedf26f1 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:08.743469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-10b0677a-d7a9-4a22-81d2-2295dedf26f1 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:08.744054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-10b0677a-d7a9-4a22-81d2-2295dedf26f1 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:08.744934 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-10b0677a-d7a9-4a22-81d2-2295dedf26f1 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:08.745467 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-10b0677a-d7a9-4a22-81d2-2295dedf26f1 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:08.770650 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-7507f085-9bc3-4122-adf5-57a9f3076e4d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:08.771464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-7507f085-9bc3-4122-adf5-57a9f3076e4d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:08.780095 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7507f085-9bc3-4122-adf5-57a9f3076e4d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:08.780633 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7507f085-9bc3-4122-adf5-57a9f3076e4d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:08.781481 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7507f085-9bc3-4122-adf5-57a9f3076e4d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:08.782139 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7507f085-9bc3-4122-adf5-57a9f3076e4d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:08.894456 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-10b0677a-d7a9-4a22-81d2-2295dedf26f1 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:08.903006 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-10b0677a-d7a9-4a22-81d2-2295dedf26f1 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1270 microversion: 2.1 time: 0.182921 Jul 20 08:31:08.903812 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 291/604] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:08 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1270 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:08.908234 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-5d0a0a94-574e-43ee-af74-c7dacc8be1cf req-1e12c169-b3af-4daa-9a78-7172e212856a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b295e0-508c-4cd5-b18f-3b808c0ff265", "name": "network-vif-plugged", "status": "completed", "tag": "25187f6d-a614-4168-94dd-d0c397aaf6f3"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:08.918489 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-5d0a0a94-574e-43ee-af74-c7dacc8be1cf req-1e12c169-b3af-4daa-9a78-7172e212856a service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:08.918975 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-5d0a0a94-574e-43ee-af74-c7dacc8be1cf req-1e12c169-b3af-4daa-9a78-7172e212856a service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:08.926720 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-7507f085-9bc3-4122-adf5-57a9f3076e4d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:08.930768 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-5d0a0a94-574e-43ee-af74-c7dacc8be1cf req-1e12c169-b3af-4daa-9a78-7172e212856a service nova] Creating event network-vif-plugged:25187f6d-a614-4168-94dd-d0c397aaf6f3 for instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 on hv-cinder-82308 Jul 20 08:31:08.935558 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-5d0a0a94-574e-43ee-af74-c7dacc8be1cf req-1e12c169-b3af-4daa-9a78-7172e212856a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030846 Jul 20 08:31:08.935784 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-7507f085-9bc3-4122-adf5-57a9f3076e4d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:08.936137 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 292/605] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:31:08.937519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-7507f085-9bc3-4122-adf5-57a9f3076e4d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:08.938686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-7507f085-9bc3-4122-adf5-57a9f3076e4d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1746 microversion: 2.20 time: 0.176567 Jul 20 08:31:08.939222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 314/606] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:08 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1746 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:31:08.993464 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ba8611f9-fbfc-43b4-845d-fdac9fb7cce4 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:08.994186 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ba8611f9-fbfc-43b4-845d-fdac9fb7cce4 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:09.000957 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ba8611f9-fbfc-43b4-845d-fdac9fb7cce4 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:09.001407 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ba8611f9-fbfc-43b4-845d-fdac9fb7cce4 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:09.002177 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ba8611f9-fbfc-43b4-845d-fdac9fb7cce4 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:09.002642 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ba8611f9-fbfc-43b4-845d-fdac9fb7cce4 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:09.136579 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ba8611f9-fbfc-43b4-845d-fdac9fb7cce4 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:09.144051 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ba8611f9-fbfc-43b4-845d-fdac9fb7cce4 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.156063 Jul 20 08:31:09.144605 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 293/607] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:08 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:09.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e9505514-9aab-460d-b51c-7ceeb22b5b9c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:09.922551 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e9505514-9aab-460d-b51c-7ceeb22b5b9c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:09.930849 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e9505514-9aab-460d-b51c-7ceeb22b5b9c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:09.931303 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e9505514-9aab-460d-b51c-7ceeb22b5b9c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:09.932140 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e9505514-9aab-460d-b51c-7ceeb22b5b9c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:09.932650 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e9505514-9aab-460d-b51c-7ceeb22b5b9c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:09.957194 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-25169e2a-1929-40de-b524-76dc95948eed tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:09.957793 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-25169e2a-1929-40de-b524-76dc95948eed tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:09.964749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-25169e2a-1929-40de-b524-76dc95948eed tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:09.965199 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-25169e2a-1929-40de-b524-76dc95948eed tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:09.966129 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-25169e2a-1929-40de-b524-76dc95948eed tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:09.966563 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-25169e2a-1929-40de-b524-76dc95948eed tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:10.073240 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e9505514-9aab-460d-b51c-7ceeb22b5b9c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:10.080744 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e9505514-9aab-460d-b51c-7ceeb22b5b9c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1270 microversion: 2.1 time: 0.163012 Jul 20 08:31:10.081319 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 315/608] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:09 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:10.107110 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-25169e2a-1929-40de-b524-76dc95948eed tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:10.114986 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-25169e2a-1929-40de-b524-76dc95948eed tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:10.116477 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-25169e2a-1929-40de-b524-76dc95948eed tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:10.118836 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-25169e2a-1929-40de-b524-76dc95948eed tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1746 microversion: 2.20 time: 0.165353 Jul 20 08:31:10.119407 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 294/609] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:09 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:31:10.161161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-78d1c272-ec0c-42a4-a5da-b64670b0eb8e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:10.161793 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-78d1c272-ec0c-42a4-a5da-b64670b0eb8e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:10.168455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-78d1c272-ec0c-42a4-a5da-b64670b0eb8e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:10.168905 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-78d1c272-ec0c-42a4-a5da-b64670b0eb8e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:10.169664 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-78d1c272-ec0c-42a4-a5da-b64670b0eb8e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:10.170098 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-78d1c272-ec0c-42a4-a5da-b64670b0eb8e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:10.303313 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-78d1c272-ec0c-42a4-a5da-b64670b0eb8e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:10.311280 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-78d1c272-ec0c-42a4-a5da-b64670b0eb8e tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.153939 Jul 20 08:31:10.311856 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 316/610] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:10 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:11.098162 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-91aa30f4-df4f-475e-8210-2c491b8c893f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:11.099554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-91aa30f4-df4f-475e-8210-2c491b8c893f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:11.107143 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-91aa30f4-df4f-475e-8210-2c491b8c893f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:11.107597 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-91aa30f4-df4f-475e-8210-2c491b8c893f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:11.108527 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-91aa30f4-df4f-475e-8210-2c491b8c893f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:11.108876 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-91aa30f4-df4f-475e-8210-2c491b8c893f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:11.139159 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-033f64b2-7e4b-42b5-a477-fa4b4f6715d1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:11.139928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-033f64b2-7e4b-42b5-a477-fa4b4f6715d1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:11.147374 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-033f64b2-7e4b-42b5-a477-fa4b4f6715d1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:11.147693 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-033f64b2-7e4b-42b5-a477-fa4b4f6715d1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:11.149038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-033f64b2-7e4b-42b5-a477-fa4b4f6715d1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:11.149731 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-033f64b2-7e4b-42b5-a477-fa4b4f6715d1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:11.270266 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-91aa30f4-df4f-475e-8210-2c491b8c893f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:11.278404 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-91aa30f4-df4f-475e-8210-2c491b8c893f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1270 microversion: 2.1 time: 0.184477 Jul 20 08:31:11.279038 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 295/611] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:11 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1270 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:11.327511 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-160bf92d-a2b8-4bce-806c-97345690af50 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:11.328190 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-160bf92d-a2b8-4bce-806c-97345690af50 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:11.334341 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-160bf92d-a2b8-4bce-806c-97345690af50 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:11.334919 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-160bf92d-a2b8-4bce-806c-97345690af50 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:11.335760 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-160bf92d-a2b8-4bce-806c-97345690af50 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:11.336263 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-160bf92d-a2b8-4bce-806c-97345690af50 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:11.408665 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-033f64b2-7e4b-42b5-a477-fa4b4f6715d1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:11.424950 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-033f64b2-7e4b-42b5-a477-fa4b4f6715d1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:11.428183 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-033f64b2-7e4b-42b5-a477-fa4b4f6715d1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:11.431246 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-033f64b2-7e4b-42b5-a477-fa4b4f6715d1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1746 microversion: 2.20 time: 0.295841 Jul 20 08:31:11.432935 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 317/612] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:11 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1746 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:11.475533 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-160bf92d-a2b8-4bce-806c-97345690af50 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:11.483644 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-160bf92d-a2b8-4bce-806c-97345690af50 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.160031 Jul 20 08:31:11.484217 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 296/613] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:11 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:11.914495 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-24a49f60-9f22-468b-977b-8903f0e435ff req-aeec105b-6b93-4873-9dad-005243641a8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e518b913-0606-4cd9-96f7-dfcf59ff8758", "tag": "74d72a98-84ae-4d18-bd71-3bf590c0a455"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:11.923828 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-24a49f60-9f22-468b-977b-8903f0e435ff req-aeec105b-6b93-4873-9dad-005243641a8a service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:11.923828 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-24a49f60-9f22-468b-977b-8903f0e435ff req-aeec105b-6b93-4873-9dad-005243641a8a service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:11.934990 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-24a49f60-9f22-468b-977b-8903f0e435ff req-aeec105b-6b93-4873-9dad-005243641a8a service nova] Creating event network-changed:74d72a98-84ae-4d18-bd71-3bf590c0a455 for instance e518b913-0606-4cd9-96f7-dfcf59ff8758 on hv-cinder-82308 Jul 20 08:31:11.940077 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-24a49f60-9f22-468b-977b-8903f0e435ff req-aeec105b-6b93-4873-9dad-005243641a8a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097679 Jul 20 08:31:11.940679 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 318/614] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:31:12.296872 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8e5cef93-5df5-4d97-bf04-544aa2483507 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:12.297557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8e5cef93-5df5-4d97-bf04-544aa2483507 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:12.304121 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8e5cef93-5df5-4d97-bf04-544aa2483507 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:12.304634 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8e5cef93-5df5-4d97-bf04-544aa2483507 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:12.305343 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8e5cef93-5df5-4d97-bf04-544aa2483507 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:12.305771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8e5cef93-5df5-4d97-bf04-544aa2483507 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:12.449086 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-8e5cef93-5df5-4d97-bf04-544aa2483507 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:12.453201 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c0107cc0-e531-4eef-8ab2-a6c058937e92 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:12.453889 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c0107cc0-e531-4eef-8ab2-a6c058937e92 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:12.456841 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8e5cef93-5df5-4d97-bf04-544aa2483507 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1270 microversion: 2.1 time: 0.165048 Jul 20 08:31:12.457411 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 297/615] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:12 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:12.460482 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c0107cc0-e531-4eef-8ab2-a6c058937e92 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:12.460938 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c0107cc0-e531-4eef-8ab2-a6c058937e92 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:12.461720 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c0107cc0-e531-4eef-8ab2-a6c058937e92 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:12.462185 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c0107cc0-e531-4eef-8ab2-a6c058937e92 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:12.501216 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-348d550d-08dd-4f55-84cd-f7e85d91a839 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:12.501822 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-348d550d-08dd-4f55-84cd-f7e85d91a839 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:12.508865 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-348d550d-08dd-4f55-84cd-f7e85d91a839 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:12.509774 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-348d550d-08dd-4f55-84cd-f7e85d91a839 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:12.510603 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-348d550d-08dd-4f55-84cd-f7e85d91a839 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:12.511050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-348d550d-08dd-4f55-84cd-f7e85d91a839 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:12.655806 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-348d550d-08dd-4f55-84cd-f7e85d91a839 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:12.663207 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-348d550d-08dd-4f55-84cd-f7e85d91a839 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.165708 Jul 20 08:31:12.663832 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 298/616] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:12 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:12.779141 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c0107cc0-e531-4eef-8ab2-a6c058937e92 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:12.788013 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c0107cc0-e531-4eef-8ab2-a6c058937e92 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:12.789801 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c0107cc0-e531-4eef-8ab2-a6c058937e92 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:12.791156 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c0107cc0-e531-4eef-8ab2-a6c058937e92 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1746 microversion: 2.20 time: 0.342881 Jul 20 08:31:12.802797 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 319/617] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:12 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1746 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:31:13.052188 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-4aee3fb9-6192-4b8c-8569-1729a46f0714 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:13.063204 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4aee3fb9-6192-4b8c-8569-1729a46f0714 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:13.063761 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4aee3fb9-6192-4b8c-8569-1729a46f0714 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:13.125566 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-4aee3fb9-6192-4b8c-8569-1729a46f0714 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Going to try to stop instance {{(pid=117828) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 08:31:13.158198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:13.180108 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-4aee3fb9-6192-4b8c-8569-1729a46f0714 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "POST /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc/action" status: 202 len: 0 microversion: 2.1 time: 0.131299 Jul 20 08:31:13.184289 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 299/618] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Jul 20 08:31:13 2022] POST /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:31:13.190157 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f2bbca05-e057-4364-bda8-6f2b7d00d206 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:13.191214 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f2bbca05-e057-4364-bda8-6f2b7d00d206 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:13.206682 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f2bbca05-e057-4364-bda8-6f2b7d00d206 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:13.207857 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f2bbca05-e057-4364-bda8-6f2b7d00d206 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:13.208730 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f2bbca05-e057-4364-bda8-6f2b7d00d206 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:13.209170 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f2bbca05-e057-4364-bda8-6f2b7d00d206 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:13.474303 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-883a2d39-304f-46b1-9539-e6df31093c76 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:13.475024 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-883a2d39-304f-46b1-9539-e6df31093c76 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:13.481304 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-883a2d39-304f-46b1-9539-e6df31093c76 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:13.481758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-883a2d39-304f-46b1-9539-e6df31093c76 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:13.482522 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-883a2d39-304f-46b1-9539-e6df31093c76 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:13.482987 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-883a2d39-304f-46b1-9539-e6df31093c76 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:13.528962 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f2bbca05-e057-4364-bda8-6f2b7d00d206 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:13.537114 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f2bbca05-e057-4364-bda8-6f2b7d00d206 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1723 microversion: 2.1 time: 0.351663 Jul 20 08:31:13.537748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 320/619] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:13 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1723 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:13.623803 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-883a2d39-304f-46b1-9539-e6df31093c76 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:13.631139 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-883a2d39-304f-46b1-9539-e6df31093c76 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1270 microversion: 2.1 time: 0.161629 Jul 20 08:31:13.631697 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 300/620] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:13 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:13.681281 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-0cb63659-8862-47ea-832b-ee19072a1700 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:13.681802 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-0cb63659-8862-47ea-832b-ee19072a1700 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:13.684349 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:13.690701 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0cb63659-8862-47ea-832b-ee19072a1700 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:13.691152 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0cb63659-8862-47ea-832b-ee19072a1700 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:13.691925 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0cb63659-8862-47ea-832b-ee19072a1700 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:13.692531 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0cb63659-8862-47ea-832b-ee19072a1700 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:13.810449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3ec27e75-861f-4449-9231-8151a3aa712d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:13.811188 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-3ec27e75-861f-4449-9231-8151a3aa712d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:13.817462 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ec27e75-861f-4449-9231-8151a3aa712d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:13.817988 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ec27e75-861f-4449-9231-8151a3aa712d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:13.818863 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ec27e75-861f-4449-9231-8151a3aa712d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:13.819355 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ec27e75-861f-4449-9231-8151a3aa712d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:13.905934 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0cb63659-8862-47ea-832b-ee19072a1700 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:13.917561 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-0cb63659-8862-47ea-832b-ee19072a1700 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.240433 Jul 20 08:31:13.922630 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 321/621] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:13 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:13.983433 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3ec27e75-861f-4449-9231-8151a3aa712d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:13.991941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3ec27e75-861f-4449-9231-8151a3aa712d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:13.993452 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3ec27e75-861f-4449-9231-8151a3aa712d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:13.994738 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-3ec27e75-861f-4449-9231-8151a3aa712d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1746 microversion: 2.20 time: 0.188158 Jul 20 08:31:13.995533 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 301/622] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:13 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1746 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:31:14.554304 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-758a898b-163e-4bd6-a98f-5b37ddbd894b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:14.555033 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-758a898b-163e-4bd6-a98f-5b37ddbd894b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:14.561522 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-758a898b-163e-4bd6-a98f-5b37ddbd894b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:14.561961 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-758a898b-163e-4bd6-a98f-5b37ddbd894b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:14.562744 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-758a898b-163e-4bd6-a98f-5b37ddbd894b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:14.563170 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-758a898b-163e-4bd6-a98f-5b37ddbd894b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:14.651490 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0dcaf448-c7a2-47e1-817e-ac7533d49ed6 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:14.652343 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0dcaf448-c7a2-47e1-817e-ac7533d49ed6 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:14.659185 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0dcaf448-c7a2-47e1-817e-ac7533d49ed6 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:14.659720 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0dcaf448-c7a2-47e1-817e-ac7533d49ed6 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:14.660609 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0dcaf448-c7a2-47e1-817e-ac7533d49ed6 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:14.661102 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0dcaf448-c7a2-47e1-817e-ac7533d49ed6 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:14.711500 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-758a898b-163e-4bd6-a98f-5b37ddbd894b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:14.719590 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-758a898b-163e-4bd6-a98f-5b37ddbd894b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1723 microversion: 2.1 time: 0.169169 Jul 20 08:31:14.720160 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 322/623] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:14 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:14.799681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-0dcaf448-c7a2-47e1-817e-ac7533d49ed6 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:14.808042 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0dcaf448-c7a2-47e1-817e-ac7533d49ed6 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1270 microversion: 2.1 time: 0.162886 Jul 20 08:31:14.808549 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 302/624] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:14 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:14.935568 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-b4fd95db-006e-4e04-b54b-605b6b4baa35 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:14.936173 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-b4fd95db-006e-4e04-b54b-605b6b4baa35 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:14.942163 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b4fd95db-006e-4e04-b54b-605b6b4baa35 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:14.942638 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b4fd95db-006e-4e04-b54b-605b6b4baa35 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:14.943401 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b4fd95db-006e-4e04-b54b-605b6b4baa35 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:14.943835 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b4fd95db-006e-4e04-b54b-605b6b4baa35 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:15.013932 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-eaa2dc86-5651-498f-ad3c-13bc9cb48d58 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:15.014531 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-eaa2dc86-5651-498f-ad3c-13bc9cb48d58 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:15.016756 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:15.022635 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eaa2dc86-5651-498f-ad3c-13bc9cb48d58 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:15.023135 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eaa2dc86-5651-498f-ad3c-13bc9cb48d58 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:15.024113 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eaa2dc86-5651-498f-ad3c-13bc9cb48d58 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:15.024550 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eaa2dc86-5651-498f-ad3c-13bc9cb48d58 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:15.074496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b4fd95db-006e-4e04-b54b-605b6b4baa35 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:15.081967 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-b4fd95db-006e-4e04-b54b-605b6b4baa35 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.150300 Jul 20 08:31:15.082535 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 323/625] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:14 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:15.156709 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-eaa2dc86-5651-498f-ad3c-13bc9cb48d58 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:15.166819 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-eaa2dc86-5651-498f-ad3c-13bc9cb48d58 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:15.168348 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-eaa2dc86-5651-498f-ad3c-13bc9cb48d58 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:15.169509 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-eaa2dc86-5651-498f-ad3c-13bc9cb48d58 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1746 microversion: 2.20 time: 0.159427 Jul 20 08:31:15.170073 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 303/626] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:15 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:15.451386 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-5f1cc730-5c1e-48ee-91fc-43d0ceb1469a req-03ac3efd-243d-40b4-9ba2-0a707d7ca333 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a437f068-8b36-411d-ab25-a00ec30b71de", "name": "network-vif-plugged", "status": "completed", "tag": "26b6ab63-8e74-43dc-82a1-e3067592fa61"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:15.460322 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-5f1cc730-5c1e-48ee-91fc-43d0ceb1469a req-03ac3efd-243d-40b4-9ba2-0a707d7ca333 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:15.461350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-5f1cc730-5c1e-48ee-91fc-43d0ceb1469a req-03ac3efd-243d-40b4-9ba2-0a707d7ca333 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:15.473391 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-5f1cc730-5c1e-48ee-91fc-43d0ceb1469a req-03ac3efd-243d-40b4-9ba2-0a707d7ca333 service nova] Creating event network-vif-plugged:26b6ab63-8e74-43dc-82a1-e3067592fa61 for instance a437f068-8b36-411d-ab25-a00ec30b71de on hv-cinder-82308 Jul 20 08:31:15.479054 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-5f1cc730-5c1e-48ee-91fc-43d0ceb1469a req-03ac3efd-243d-40b4-9ba2-0a707d7ca333 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031591 Jul 20 08:31:15.479856 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 324/627] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:31:15.737471 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a518b536-67e2-42ab-b33d-1b8b84d74052 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:15.738705 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a518b536-67e2-42ab-b33d-1b8b84d74052 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:15.745493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a518b536-67e2-42ab-b33d-1b8b84d74052 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:15.746006 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a518b536-67e2-42ab-b33d-1b8b84d74052 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:15.746813 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a518b536-67e2-42ab-b33d-1b8b84d74052 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:15.747254 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a518b536-67e2-42ab-b33d-1b8b84d74052 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:15.827420 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5dd49e1b-1fab-49ad-bf05-d60a4e841231 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:15.828412 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5dd49e1b-1fab-49ad-bf05-d60a4e841231 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:15.835870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5dd49e1b-1fab-49ad-bf05-d60a4e841231 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:15.836579 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5dd49e1b-1fab-49ad-bf05-d60a4e841231 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:15.838455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5dd49e1b-1fab-49ad-bf05-d60a4e841231 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:15.839105 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5dd49e1b-1fab-49ad-bf05-d60a4e841231 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:15.891658 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a518b536-67e2-42ab-b33d-1b8b84d74052 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:15.904385 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a518b536-67e2-42ab-b33d-1b8b84d74052 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1723 microversion: 2.1 time: 0.170647 Jul 20 08:31:15.905434 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 304/628] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:15 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:16.001623 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5dd49e1b-1fab-49ad-bf05-d60a4e841231 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:16.015903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5dd49e1b-1fab-49ad-bf05-d60a4e841231 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1270 microversion: 2.1 time: 0.194304 Jul 20 08:31:16.016787 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 325/629] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:15 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1270 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:16.098638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-eb5edabd-d586-4583-8760-854364b9bcf7 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:16.099463 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-eb5edabd-d586-4583-8760-854364b9bcf7 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:16.105950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eb5edabd-d586-4583-8760-854364b9bcf7 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:16.106414 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eb5edabd-d586-4583-8760-854364b9bcf7 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:16.107305 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eb5edabd-d586-4583-8760-854364b9bcf7 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:16.107697 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eb5edabd-d586-4583-8760-854364b9bcf7 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:16.188574 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8500e542-9dc6-4e67-b339-ca7fdb94e17e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:16.189178 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8500e542-9dc6-4e67-b339-ca7fdb94e17e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:16.195815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8500e542-9dc6-4e67-b339-ca7fdb94e17e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:16.197433 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8500e542-9dc6-4e67-b339-ca7fdb94e17e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:16.197843 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8500e542-9dc6-4e67-b339-ca7fdb94e17e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:16.198399 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8500e542-9dc6-4e67-b339-ca7fdb94e17e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:16.257709 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-eb5edabd-d586-4583-8760-854364b9bcf7 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:16.267059 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-eb5edabd-d586-4583-8760-854364b9bcf7 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.172199 Jul 20 08:31:16.267641 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 305/630] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:16 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:16.365791 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8500e542-9dc6-4e67-b339-ca7fdb94e17e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:16.380786 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8500e542-9dc6-4e67-b339-ca7fdb94e17e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:16.386207 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8500e542-9dc6-4e67-b339-ca7fdb94e17e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:16.387533 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8500e542-9dc6-4e67-b339-ca7fdb94e17e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1741 microversion: 2.20 time: 0.202887 Jul 20 08:31:16.392846 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 326/631] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:16 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1741 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:31:16.928656 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b8d08500-4c30-4788-aaf9-7daad092a58e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:16.929622 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b8d08500-4c30-4788-aaf9-7daad092a58e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:16.941564 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b8d08500-4c30-4788-aaf9-7daad092a58e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:16.942864 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b8d08500-4c30-4788-aaf9-7daad092a58e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:16.944635 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b8d08500-4c30-4788-aaf9-7daad092a58e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:16.945549 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b8d08500-4c30-4788-aaf9-7daad092a58e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:17.039784 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3bab41f1-b65b-45ca-9b30-7cdffffdbeb0 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:17.043557 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3bab41f1-b65b-45ca-9b30-7cdffffdbeb0 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:17.067406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3bab41f1-b65b-45ca-9b30-7cdffffdbeb0 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:17.068341 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3bab41f1-b65b-45ca-9b30-7cdffffdbeb0 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:17.069474 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3bab41f1-b65b-45ca-9b30-7cdffffdbeb0 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:17.070251 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3bab41f1-b65b-45ca-9b30-7cdffffdbeb0 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:17.124850 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:17.183138 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b8d08500-4c30-4788-aaf9-7daad092a58e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:17.192638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b8d08500-4c30-4788-aaf9-7daad092a58e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1723 microversion: 2.1 time: 0.271151 Jul 20 08:31:17.198063 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 306/632] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:16 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:17.266969 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3bab41f1-b65b-45ca-9b30-7cdffffdbeb0 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:17.280406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3bab41f1-b65b-45ca-9b30-7cdffffdbeb0 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1270 microversion: 2.1 time: 0.250551 Jul 20 08:31:17.281293 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 327/633] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:17 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1270 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:17.284352 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-bc721dcc-a10c-4808-83e4-f50559a56ea5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:17.284954 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-bc721dcc-a10c-4808-83e4-f50559a56ea5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:17.291666 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bc721dcc-a10c-4808-83e4-f50559a56ea5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:17.292213 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bc721dcc-a10c-4808-83e4-f50559a56ea5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:17.293073 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bc721dcc-a10c-4808-83e4-f50559a56ea5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:17.293517 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bc721dcc-a10c-4808-83e4-f50559a56ea5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:17.407591 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4e031549-6a9c-4d1e-8ad2-d94b76c8bdcb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:17.408492 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4e031549-6a9c-4d1e-8ad2-d94b76c8bdcb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:17.416766 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4e031549-6a9c-4d1e-8ad2-d94b76c8bdcb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:17.417498 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4e031549-6a9c-4d1e-8ad2-d94b76c8bdcb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:17.418460 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4e031549-6a9c-4d1e-8ad2-d94b76c8bdcb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:17.419111 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4e031549-6a9c-4d1e-8ad2-d94b76c8bdcb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:17.474456 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-bc721dcc-a10c-4808-83e4-f50559a56ea5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:17.488107 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-bc721dcc-a10c-4808-83e4-f50559a56ea5 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.202991 Jul 20 08:31:17.489852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 307/634] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:17 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:17.617302 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4e031549-6a9c-4d1e-8ad2-d94b76c8bdcb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:17.626135 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4e031549-6a9c-4d1e-8ad2-d94b76c8bdcb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:17.628034 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4e031549-6a9c-4d1e-8ad2-d94b76c8bdcb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:17.629311 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4e031549-6a9c-4d1e-8ad2-d94b76c8bdcb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1741 microversion: 2.20 time: 0.225760 Jul 20 08:31:17.641622 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 328/635] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:17 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1741 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:31:18.297727 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4381f2cd-9014-4abd-913d-1e5859f5cc74 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:18.298863 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4381f2cd-9014-4abd-913d-1e5859f5cc74 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:18.305746 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4381f2cd-9014-4abd-913d-1e5859f5cc74 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:18.307059 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4381f2cd-9014-4abd-913d-1e5859f5cc74 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:18.308398 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4381f2cd-9014-4abd-913d-1e5859f5cc74 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:18.308398 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4381f2cd-9014-4abd-913d-1e5859f5cc74 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:18.332680 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f32dc250-8300-4746-ae3d-72bb0d8aec3a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:18.333291 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f32dc250-8300-4746-ae3d-72bb0d8aec3a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:18.339593 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f32dc250-8300-4746-ae3d-72bb0d8aec3a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:18.340040 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f32dc250-8300-4746-ae3d-72bb0d8aec3a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:18.340844 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f32dc250-8300-4746-ae3d-72bb0d8aec3a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:18.341286 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f32dc250-8300-4746-ae3d-72bb0d8aec3a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:18.449840 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4381f2cd-9014-4abd-913d-1e5859f5cc74 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:18.457635 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4381f2cd-9014-4abd-913d-1e5859f5cc74 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1270 microversion: 2.1 time: 0.164124 Jul 20 08:31:18.458216 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 329/636] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:18 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:18.504955 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f32dc250-8300-4746-ae3d-72bb0d8aec3a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:18.505542 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a7a4a74a-dd94-4b97-ad4e-d3a62b54b0ea tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:18.506381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a7a4a74a-dd94-4b97-ad4e-d3a62b54b0ea tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:18.516270 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f32dc250-8300-4746-ae3d-72bb0d8aec3a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1723 microversion: 2.1 time: 0.294669 Jul 20 08:31:18.521585 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a7a4a74a-dd94-4b97-ad4e-d3a62b54b0ea tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:18.522137 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a7a4a74a-dd94-4b97-ad4e-d3a62b54b0ea tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:18.523055 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a7a4a74a-dd94-4b97-ad4e-d3a62b54b0ea tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:18.523287 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 308/637] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:18 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:18.524014 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a7a4a74a-dd94-4b97-ad4e-d3a62b54b0ea tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:18.649184 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d9c9058b-6b39-4648-ac16-ebf78f59ef2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:18.650864 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d9c9058b-6b39-4648-ac16-ebf78f59ef2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:18.659604 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d9c9058b-6b39-4648-ac16-ebf78f59ef2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:18.660038 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d9c9058b-6b39-4648-ac16-ebf78f59ef2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:18.663533 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d9c9058b-6b39-4648-ac16-ebf78f59ef2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:18.664233 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d9c9058b-6b39-4648-ac16-ebf78f59ef2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:18.714428 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a7a4a74a-dd94-4b97-ad4e-d3a62b54b0ea tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:18.722200 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a7a4a74a-dd94-4b97-ad4e-d3a62b54b0ea tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1358 microversion: 2.1 time: 0.220595 Jul 20 08:31:18.722812 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 330/638] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:18 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:18.823400 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d9c9058b-6b39-4648-ac16-ebf78f59ef2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:18.831411 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d9c9058b-6b39-4648-ac16-ebf78f59ef2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:18.832901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d9c9058b-6b39-4648-ac16-ebf78f59ef2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:18.834038 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d9c9058b-6b39-4648-ac16-ebf78f59ef2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1741 microversion: 2.20 time: 0.188977 Jul 20 08:31:18.834641 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 309/639] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:18 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:31:19.475617 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f065cb16-3a7a-4c73-81c9-975f8bea5c4b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:19.476309 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f065cb16-3a7a-4c73-81c9-975f8bea5c4b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:19.483367 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f065cb16-3a7a-4c73-81c9-975f8bea5c4b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:19.483780 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f065cb16-3a7a-4c73-81c9-975f8bea5c4b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:19.484553 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f065cb16-3a7a-4c73-81c9-975f8bea5c4b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:19.484984 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f065cb16-3a7a-4c73-81c9-975f8bea5c4b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:19.535111 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-083c2cf4-e099-44b9-b62a-c907127268a5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:19.538262 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-083c2cf4-e099-44b9-b62a-c907127268a5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:19.546810 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-083c2cf4-e099-44b9-b62a-c907127268a5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:19.547855 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-083c2cf4-e099-44b9-b62a-c907127268a5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:19.548897 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-083c2cf4-e099-44b9-b62a-c907127268a5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:19.549529 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-083c2cf4-e099-44b9-b62a-c907127268a5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:19.661208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f065cb16-3a7a-4c73-81c9-975f8bea5c4b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:19.670309 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f065cb16-3a7a-4c73-81c9-975f8bea5c4b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1270 microversion: 2.1 time: 0.198731 Jul 20 08:31:19.679486 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 331/640] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:19 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1270 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:19.739502 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-48cef282-dffb-4065-9aff-12d6d73f978a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:19.740012 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-48cef282-dffb-4065-9aff-12d6d73f978a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:19.747733 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-48cef282-dffb-4065-9aff-12d6d73f978a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:19.748428 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-48cef282-dffb-4065-9aff-12d6d73f978a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:19.749646 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-48cef282-dffb-4065-9aff-12d6d73f978a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:19.750077 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-48cef282-dffb-4065-9aff-12d6d73f978a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:19.752366 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-083c2cf4-e099-44b9-b62a-c907127268a5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:19.768584 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-083c2cf4-e099-44b9-b62a-c907127268a5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1723 microversion: 2.1 time: 0.231801 Jul 20 08:31:19.769493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 310/641] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:19 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:19.855850 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ff052353-a28c-4b96-a5c9-4bf36df7df3e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:19.856837 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ff052353-a28c-4b96-a5c9-4bf36df7df3e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:19.863319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ff052353-a28c-4b96-a5c9-4bf36df7df3e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:19.863768 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ff052353-a28c-4b96-a5c9-4bf36df7df3e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:19.864534 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ff052353-a28c-4b96-a5c9-4bf36df7df3e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:19.864961 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ff052353-a28c-4b96-a5c9-4bf36df7df3e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:19.895951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-48cef282-dffb-4065-9aff-12d6d73f978a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:19.904662 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-48cef282-dffb-4065-9aff-12d6d73f978a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1546 microversion: 2.1 time: 0.168968 Jul 20 08:31:19.905578 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 332/642] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:19 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1546 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:19.923843 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-339dcdf6-2d04-4285-ae2e-6be5c5c966b0 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:19.924779 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-339dcdf6-2d04-4285-ae2e-6be5c5c966b0 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:19.931643 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-339dcdf6-2d04-4285-ae2e-6be5c5c966b0 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:19.932468 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-339dcdf6-2d04-4285-ae2e-6be5c5c966b0 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:19.933490 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-339dcdf6-2d04-4285-ae2e-6be5c5c966b0 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:19.934142 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-339dcdf6-2d04-4285-ae2e-6be5c5c966b0 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:20.021081 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ff052353-a28c-4b96-a5c9-4bf36df7df3e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:20.033838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ff052353-a28c-4b96-a5c9-4bf36df7df3e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:20.035376 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ff052353-a28c-4b96-a5c9-4bf36df7df3e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:20.036528 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ff052353-a28c-4b96-a5c9-4bf36df7df3e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1741 microversion: 2.20 time: 0.186476 Jul 20 08:31:20.037266 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 311/643] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:19 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1741 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:20.092321 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-339dcdf6-2d04-4285-ae2e-6be5c5c966b0 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:20.100623 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-339dcdf6-2d04-4285-ae2e-6be5c5c966b0 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1546 microversion: 2.1 time: 0.180469 Jul 20 08:31:20.101194 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 333/644] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:19 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1546 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:20.118230 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d46af0e9-f843-4111-aa2a-878dd1923bae tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:20.126947 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d46af0e9-f843-4111-aa2a-878dd1923bae tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:20.128015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d46af0e9-f843-4111-aa2a-878dd1923bae tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Searching by: {'deleted': False, 'project_id': '5732783c305f47a389104f7ea5ac5fcf'} {{(pid=117828) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 08:31:20.136749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d46af0e9-f843-4111-aa2a-878dd1923bae tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:20.137239 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d46af0e9-f843-4111-aa2a-878dd1923bae tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:20.138090 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d46af0e9-f843-4111-aa2a-878dd1923bae tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:20.138705 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d46af0e9-f843-4111-aa2a-878dd1923bae tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:20.233195 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.multi_cell_list [None req-d46af0e9-f843-4111-aa2a-878dd1923bae tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117828) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 08:31:20.341274 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d46af0e9-f843-4111-aa2a-878dd1923bae tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.227688 Jul 20 08:31:20.341785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 312/645] 10.222.0.64 () {58 vars in 1124 bytes} [Wed Jul 20 08:31:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:31:20.351990 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6715bf5a-5da0-499a-b9d5-035290444ca3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:20.352606 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6715bf5a-5da0-499a-b9d5-035290444ca3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:20.358893 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6715bf5a-5da0-499a-b9d5-035290444ca3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:20.359332 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6715bf5a-5da0-499a-b9d5-035290444ca3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:20.360116 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6715bf5a-5da0-499a-b9d5-035290444ca3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:20.360599 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6715bf5a-5da0-499a-b9d5-035290444ca3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:20.529514 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6715bf5a-5da0-499a-b9d5-035290444ca3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:20.539083 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6715bf5a-5da0-499a-b9d5-035290444ca3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1546 microversion: 2.1 time: 0.190888 Jul 20 08:31:20.540204 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 334/646] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:20 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1546 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:20.688950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-592b69b6-2261-40f3-b0c5-fb2d264ea85e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:20.690461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-592b69b6-2261-40f3-b0c5-fb2d264ea85e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:20.698758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-592b69b6-2261-40f3-b0c5-fb2d264ea85e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:20.699598 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-592b69b6-2261-40f3-b0c5-fb2d264ea85e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:20.700692 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-592b69b6-2261-40f3-b0c5-fb2d264ea85e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:20.701306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-592b69b6-2261-40f3-b0c5-fb2d264ea85e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:20.786054 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d5be9927-a382-4e94-9c12-21768ccdee07 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:20.786917 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d5be9927-a382-4e94-9c12-21768ccdee07 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:20.796525 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d5be9927-a382-4e94-9c12-21768ccdee07 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:20.797338 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d5be9927-a382-4e94-9c12-21768ccdee07 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:20.798523 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d5be9927-a382-4e94-9c12-21768ccdee07 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:20.799229 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d5be9927-a382-4e94-9c12-21768ccdee07 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:21.054612 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-592b69b6-2261-40f3-b0c5-fb2d264ea85e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:21.065106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-592b69b6-2261-40f3-b0c5-fb2d264ea85e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1270 microversion: 2.1 time: 0.380382 Jul 20 08:31:21.079331 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 313/647] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:20 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1270 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:21.092405 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0bdc2ade-c994-453f-a168-5c3e52a33728 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:21.093406 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0bdc2ade-c994-453f-a168-5c3e52a33728 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:21.116406 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0bdc2ade-c994-453f-a168-5c3e52a33728 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:21.119021 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0bdc2ade-c994-453f-a168-5c3e52a33728 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:21.120293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0bdc2ade-c994-453f-a168-5c3e52a33728 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:21.121066 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0bdc2ade-c994-453f-a168-5c3e52a33728 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:21.138605 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d5be9927-a382-4e94-9c12-21768ccdee07 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:21.151067 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d5be9927-a382-4e94-9c12-21768ccdee07 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1723 microversion: 2.1 time: 0.368770 Jul 20 08:31:21.162795 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 335/648] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:20 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1723 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:21.239033 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8764d0e5-7310-4e33-9539-fc59436a620b tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Action: 'create', calling method: .version_select at 0x7fe399eb5670>, body: {"keypair": {"name": "tempest-keypair-1364603889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOBz3gQ0TOoLbMozd+FD/akjFxU2UBDHNtjo/zAxF75fUCUi2R/nyw6rxcw2uBXwaXvnHRaR9yV6bihZrI8e2Kt8S8b3Ob1hBUfmhyu+CDTtkNKpeL3SKH4Ufh69GUazA=="}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:21.263793 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-8764d0e5-7310-4e33-9539-fc59436a620b tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Getting quotas for project 60ee8039b1f4461c996165d5801b91f1. Resources: {'key_pairs'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:31:21.269289 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-8764d0e5-7310-4e33-9539-fc59436a620b tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Getting quotas for user e6c2070c6d2a450c887b8ca6b97c4b38 and project 60ee8039b1f4461c996165d5801b91f1. Resources: {'key_pairs'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:31:21.302743 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8764d0e5-7310-4e33-9539-fc59436a620b tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068347 Jul 20 08:31:21.309908 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 336/649] 10.222.0.64 () {60 vars in 1158 bytes} [Wed Jul 20 08:31:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:31:21.326381 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-0bdc2ade-c994-453f-a168-5c3e52a33728 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:21.336460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-0bdc2ade-c994-453f-a168-5c3e52a33728 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:21.338510 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-0bdc2ade-c994-453f-a168-5c3e52a33728 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:21.339785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0bdc2ade-c994-453f-a168-5c3e52a33728 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1741 microversion: 2.20 time: 0.259191 Jul 20 08:31:21.341357 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 314/650] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:21 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1741 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:22.084689 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ee773489-b8a9-4c35-a116-820125754dac tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:22.086060 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ee773489-b8a9-4c35-a116-820125754dac tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:22.093851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ee773489-b8a9-4c35-a116-820125754dac tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:22.094676 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ee773489-b8a9-4c35-a116-820125754dac tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:22.095774 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ee773489-b8a9-4c35-a116-820125754dac tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:22.096438 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ee773489-b8a9-4c35-a116-820125754dac tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:22.169595 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e09e667f-da3b-4c20-b4b0-f89202fb42b9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:22.170840 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-e09e667f-da3b-4c20-b4b0-f89202fb42b9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:22.177478 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e09e667f-da3b-4c20-b4b0-f89202fb42b9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:22.178058 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e09e667f-da3b-4c20-b4b0-f89202fb42b9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:22.178860 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e09e667f-da3b-4c20-b4b0-f89202fb42b9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:22.179348 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e09e667f-da3b-4c20-b4b0-f89202fb42b9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:22.374156 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e09e667f-da3b-4c20-b4b0-f89202fb42b9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:22.383765 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:22.390829 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e09e667f-da3b-4c20-b4b0-f89202fb42b9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1723 microversion: 2.1 time: 0.225286 Jul 20 08:31:22.391722 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 315/651] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:22 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:22.398222 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-08485a92-47d3-4086-bd85-23a5ff6d78d5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:22.399776 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-08485a92-47d3-4086-bd85-23a5ff6d78d5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:22.401201 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ee773489-b8a9-4c35-a116-820125754dac tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:22.411025 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-08485a92-47d3-4086-bd85-23a5ff6d78d5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:22.411573 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-08485a92-47d3-4086-bd85-23a5ff6d78d5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:22.412419 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-08485a92-47d3-4086-bd85-23a5ff6d78d5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:22.413079 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-08485a92-47d3-4086-bd85-23a5ff6d78d5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:22.417552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ee773489-b8a9-4c35-a116-820125754dac tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.336806 Jul 20 08:31:22.418705 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 337/652] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:22 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:22.608051 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-08485a92-47d3-4086-bd85-23a5ff6d78d5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:22.617889 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-08485a92-47d3-4086-bd85-23a5ff6d78d5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:22.621087 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-08485a92-47d3-4086-bd85-23a5ff6d78d5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:22.623135 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-08485a92-47d3-4086-bd85-23a5ff6d78d5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1741 microversion: 2.20 time: 0.229634 Jul 20 08:31:22.624009 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 316/653] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:22 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1741 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:22.918184 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-7be0f8cb-5666-410b-86d4-7bba2afe9d82 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-940987543", "imageRef": "5d6b971e-8afe-4e4a-b054-20cd61970c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21da7406-374d-4389-9eee-8af0140c04bf"}], "security_groups": [{"name": "tempest-securitygroup--1668777822"}], "key_name": "tempest-keypair-1364603889", "user_data": "}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:23.030728 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.network.neutron [None req-7be0f8cb-5666-410b-86d4-7bba2afe9d82 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] validate_networks() for [('21da7406-374d-4389-9eee-8af0140c04bf', None, None, None, None, None)] {{(pid=117829) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:31:23.411370 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a734786e-ff8e-4b1e-8051-5e7b9808855e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:23.411982 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a734786e-ff8e-4b1e-8051-5e7b9808855e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:23.419227 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a734786e-ff8e-4b1e-8051-5e7b9808855e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:23.419664 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a734786e-ff8e-4b1e-8051-5e7b9808855e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:23.420426 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a734786e-ff8e-4b1e-8051-5e7b9808855e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:23.421034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a734786e-ff8e-4b1e-8051-5e7b9808855e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:23.516238 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-7be0f8cb-5666-410b-86d4-7bba2afe9d82 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Flavor limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:31:23.516737 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-7be0f8cb-5666-410b-86d4-7bba2afe9d82 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Image limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:31:23.517100 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-7be0f8cb-5666-410b-86d4-7bba2afe9d82 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Flavor pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:31:23.517499 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-7be0f8cb-5666-410b-86d4-7bba2afe9d82 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Image pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:31:23.517909 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-7be0f8cb-5666-410b-86d4-7bba2afe9d82 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:31:23.529346 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7be0f8cb-5666-410b-86d4-7bba2afe9d82 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:23.529720 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7be0f8cb-5666-410b-86d4-7bba2afe9d82 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:23.530520 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7be0f8cb-5666-410b-86d4-7bba2afe9d82 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:23.530975 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7be0f8cb-5666-410b-86d4-7bba2afe9d82 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:23.548290 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-7be0f8cb-5666-410b-86d4-7bba2afe9d82 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Getting quotas for project 60ee8039b1f4461c996165d5801b91f1. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:31:23.554243 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-7be0f8cb-5666-410b-86d4-7bba2afe9d82 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Getting quotas for user e6c2070c6d2a450c887b8ca6b97c4b38 and project 60ee8039b1f4461c996165d5801b91f1. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:31:23.566221 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-7be0f8cb-5666-410b-86d4-7bba2afe9d82 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Going to run 1 instances... {{(pid=117829) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:31:23.568699 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-7be0f8cb-5666-410b-86d4-7bba2afe9d82 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d6b971e-8afe-4e4a-b054-20cd61970c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117829) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:31:23.581995 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a734786e-ff8e-4b1e-8051-5e7b9808855e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:23.590645 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a734786e-ff8e-4b1e-8051-5e7b9808855e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1723 microversion: 2.1 time: 0.185323 Jul 20 08:31:23.591438 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 317/654] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:23 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:23.596399 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-89978fee-e569-4c3e-a671-a77d86cd7cd3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b00d1a8-a20d-43d3-815c-5a3b044d96a2"}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:23.597792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-89978fee-e569-4c3e-a671-a77d86cd7cd3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:23.605814 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-89978fee-e569-4c3e-a671-a77d86cd7cd3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:23.606218 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-89978fee-e569-4c3e-a671-a77d86cd7cd3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:23.607286 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-89978fee-e569-4c3e-a671-a77d86cd7cd3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:23.608123 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-89978fee-e569-4c3e-a671-a77d86cd7cd3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:23.624420 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-7be0f8cb-5666-410b-86d4-7bba2afe9d82 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.711848 Jul 20 08:31:23.625141 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 338/655] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Jul 20 08:31:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 08:31:23.630134 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d1efad03-1fc2-495f-a481-89d227097358 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:23.631121 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d1efad03-1fc2-495f-a481-89d227097358 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:23.639078 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d1efad03-1fc2-495f-a481-89d227097358 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:23.639527 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d1efad03-1fc2-495f-a481-89d227097358 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:23.640302 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d1efad03-1fc2-495f-a481-89d227097358 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:23.640741 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d1efad03-1fc2-495f-a481-89d227097358 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:23.813880 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d1efad03-1fc2-495f-a481-89d227097358 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:23.826302 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d1efad03-1fc2-495f-a481-89d227097358 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.199558 Jul 20 08:31:23.826788 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 339/656] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:23 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:23.848494 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-376fe2c9-8ea6-4574-8aea-a78a70491454 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:23.849108 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-376fe2c9-8ea6-4574-8aea-a78a70491454 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:23.933614 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-376fe2c9-8ea6-4574-8aea-a78a70491454 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:23.942032 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-376fe2c9-8ea6-4574-8aea-a78a70491454 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1241 microversion: 2.1 time: 0.113584 Jul 20 08:31:23.943239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 340/657] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:23 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1241 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:23.950381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3a956d31-0cee-4559-b6b4-f34476fe0666 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:23.950381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3a956d31-0cee-4559-b6b4-f34476fe0666 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:23.957024 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3a956d31-0cee-4559-b6b4-f34476fe0666 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:23.957815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3a956d31-0cee-4559-b6b4-f34476fe0666 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:23.959202 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3a956d31-0cee-4559-b6b4-f34476fe0666 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:23.959955 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3a956d31-0cee-4559-b6b4-f34476fe0666 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:23.995285 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-89978fee-e569-4c3e-a671-a77d86cd7cd3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "POST /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.401291 Jul 20 08:31:23.996531 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 318/658] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Jul 20 08:31:23 2022] POST /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de/os-volume_attachments => generated 194 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:31:24.168549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3a956d31-0cee-4559-b6b4-f34476fe0666 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:24.177636 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3a956d31-0cee-4559-b6b4-f34476fe0666 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:24.179185 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3a956d31-0cee-4559-b6b4-f34476fe0666 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:24.180391 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3a956d31-0cee-4559-b6b4-f34476fe0666 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1741 microversion: 2.20 time: 0.234898 Jul 20 08:31:24.182615 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 341/659] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:23 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1741 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:24.610985 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9f7dba0c-4acf-4c03-9b1a-10138d64d310 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:24.611755 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9f7dba0c-4acf-4c03-9b1a-10138d64d310 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:24.626762 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9f7dba0c-4acf-4c03-9b1a-10138d64d310 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:24.627506 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9f7dba0c-4acf-4c03-9b1a-10138d64d310 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:24.628551 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9f7dba0c-4acf-4c03-9b1a-10138d64d310 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:24.629136 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9f7dba0c-4acf-4c03-9b1a-10138d64d310 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:24.788149 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9f7dba0c-4acf-4c03-9b1a-10138d64d310 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:24.807602 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9f7dba0c-4acf-4c03-9b1a-10138d64d310 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1723 microversion: 2.1 time: 0.192420 Jul 20 08:31:24.808525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 319/660] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:24 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:24.843619 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-80744ee4-7951-4357-bdca-52168a3fdf30 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:24.844229 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-80744ee4-7951-4357-bdca-52168a3fdf30 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:24.850960 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-80744ee4-7951-4357-bdca-52168a3fdf30 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:24.851366 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-80744ee4-7951-4357-bdca-52168a3fdf30 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:24.852163 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-80744ee4-7951-4357-bdca-52168a3fdf30 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:24.852623 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-80744ee4-7951-4357-bdca-52168a3fdf30 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:24.959368 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a28ec4bc-02ab-492b-ac15-d993c47ee5fa tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:24.959976 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a28ec4bc-02ab-492b-ac15-d993c47ee5fa tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:24.971584 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a28ec4bc-02ab-492b-ac15-d993c47ee5fa tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:24.972035 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a28ec4bc-02ab-492b-ac15-d993c47ee5fa tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:24.972818 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a28ec4bc-02ab-492b-ac15-d993c47ee5fa tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:24.973258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a28ec4bc-02ab-492b-ac15-d993c47ee5fa tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:24.997143 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-80744ee4-7951-4357-bdca-52168a3fdf30 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:25.007929 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-80744ee4-7951-4357-bdca-52168a3fdf30 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.168128 Jul 20 08:31:25.010122 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 342/661] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:24 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:25.046550 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a28ec4bc-02ab-492b-ac15-d993c47ee5fa tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:25.054221 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a28ec4bc-02ab-492b-ac15-d993c47ee5fa tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1293 microversion: 2.1 time: 0.098866 Jul 20 08:31:25.064747 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 320/662] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:24 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1293 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:25.199370 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3c7f3af9-d205-4d53-bd49-8975ff1f11e7 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:25.200298 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3c7f3af9-d205-4d53-bd49-8975ff1f11e7 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:25.208036 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3c7f3af9-d205-4d53-bd49-8975ff1f11e7 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:25.208861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3c7f3af9-d205-4d53-bd49-8975ff1f11e7 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:25.209906 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3c7f3af9-d205-4d53-bd49-8975ff1f11e7 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:25.210425 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3c7f3af9-d205-4d53-bd49-8975ff1f11e7 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:25.449348 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3c7f3af9-d205-4d53-bd49-8975ff1f11e7 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:25.457811 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3c7f3af9-d205-4d53-bd49-8975ff1f11e7 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:25.459339 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3c7f3af9-d205-4d53-bd49-8975ff1f11e7 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:25.460491 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3c7f3af9-d205-4d53-bd49-8975ff1f11e7 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1741 microversion: 2.20 time: 0.265111 Jul 20 08:31:25.461071 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 343/663] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:25 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1741 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:31:25.825579 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-dce7e84c-8dd4-41dc-98c2-379e8a1af098 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:25.826197 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-dce7e84c-8dd4-41dc-98c2-379e8a1af098 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:25.833633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-dce7e84c-8dd4-41dc-98c2-379e8a1af098 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:25.834082 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-dce7e84c-8dd4-41dc-98c2-379e8a1af098 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:25.834920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-dce7e84c-8dd4-41dc-98c2-379e8a1af098 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:25.835564 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-dce7e84c-8dd4-41dc-98c2-379e8a1af098 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:26.029385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-651a2054-a084-4227-955a-a3ddcd93db75 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:26.030443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-651a2054-a084-4227-955a-a3ddcd93db75 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:26.042815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-651a2054-a084-4227-955a-a3ddcd93db75 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:26.051074 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-dce7e84c-8dd4-41dc-98c2-379e8a1af098 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:26.055078 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-651a2054-a084-4227-955a-a3ddcd93db75 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:26.061801 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-651a2054-a084-4227-955a-a3ddcd93db75 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:26.062249 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-651a2054-a084-4227-955a-a3ddcd93db75 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:26.065898 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-dce7e84c-8dd4-41dc-98c2-379e8a1af098 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1723 microversion: 2.1 time: 0.244861 Jul 20 08:31:26.071563 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 321/664] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:25 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:26.089371 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-47a66291-2e4e-4df1-92e6-cde3821c2f09 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:26.097416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-47a66291-2e4e-4df1-92e6-cde3821c2f09 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:26.110221 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-47a66291-2e4e-4df1-92e6-cde3821c2f09 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:26.113091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-47a66291-2e4e-4df1-92e6-cde3821c2f09 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:26.114131 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-47a66291-2e4e-4df1-92e6-cde3821c2f09 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:26.114920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-47a66291-2e4e-4df1-92e6-cde3821c2f09 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:26.383308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-47a66291-2e4e-4df1-92e6-cde3821c2f09 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:26.395214 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-47a66291-2e4e-4df1-92e6-cde3821c2f09 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1367 microversion: 2.1 time: 0.316176 Jul 20 08:31:26.397133 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 322/665] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:26 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:26.474042 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-651a2054-a084-4227-955a-a3ddcd93db75 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:26.480517 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-406a7c5f-5111-4546-b11c-18df7de39f6f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:26.481202 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-406a7c5f-5111-4546-b11c-18df7de39f6f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:26.483130 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-651a2054-a084-4227-955a-a3ddcd93db75 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.459610 Jul 20 08:31:26.491888 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-406a7c5f-5111-4546-b11c-18df7de39f6f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:26.492686 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-406a7c5f-5111-4546-b11c-18df7de39f6f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:26.493099 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 344/666] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:26 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:26.495537 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-406a7c5f-5111-4546-b11c-18df7de39f6f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:26.496768 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-406a7c5f-5111-4546-b11c-18df7de39f6f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:26.693525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-406a7c5f-5111-4546-b11c-18df7de39f6f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:26.702956 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-406a7c5f-5111-4546-b11c-18df7de39f6f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:26.704505 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-406a7c5f-5111-4546-b11c-18df7de39f6f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:26.705739 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-406a7c5f-5111-4546-b11c-18df7de39f6f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1741 microversion: 2.20 time: 0.230011 Jul 20 08:31:26.706767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 323/667] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:26 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1741 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:27.088837 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-858f9db7-cd31-42de-85cc-aa8d45088425 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:27.089451 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-858f9db7-cd31-42de-85cc-aa8d45088425 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:27.097332 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-858f9db7-cd31-42de-85cc-aa8d45088425 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:27.097777 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-858f9db7-cd31-42de-85cc-aa8d45088425 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:27.098559 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-858f9db7-cd31-42de-85cc-aa8d45088425 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:27.099107 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-858f9db7-cd31-42de-85cc-aa8d45088425 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:27.292310 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-afd65597-f4ba-43aa-8f36-ac5a94ab816e req-e6f1123b-028e-4268-af7a-912122ce6546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28eb9e1d-9ca5-43a1-8330-ae91249f609c", "tag": "70393be6-628d-4634-90f4-13212f783bcf"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:27.314972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-afd65597-f4ba-43aa-8f36-ac5a94ab816e req-e6f1123b-028e-4268-af7a-912122ce6546 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:27.315699 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-afd65597-f4ba-43aa-8f36-ac5a94ab816e req-e6f1123b-028e-4268-af7a-912122ce6546 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:27.357184 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-afd65597-f4ba-43aa-8f36-ac5a94ab816e req-e6f1123b-028e-4268-af7a-912122ce6546 service nova] Creating event network-changed:70393be6-628d-4634-90f4-13212f783bcf for instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c on hv-cinder-82308 Jul 20 08:31:27.363657 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-858f9db7-cd31-42de-85cc-aa8d45088425 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:27.363865 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-afd65597-f4ba-43aa-8f36-ac5a94ab816e req-e6f1123b-028e-4268-af7a-912122ce6546 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077394 Jul 20 08:31:27.365030 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 324/668] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:31:27.376307 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-858f9db7-cd31-42de-85cc-aa8d45088425 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1723 microversion: 2.1 time: 0.291238 Jul 20 08:31:27.377032 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 345/669] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:27 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:27.413741 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-145cd1ae-c7a1-4cf4-a8dc-93fecda5fb06 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:27.414761 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-145cd1ae-c7a1-4cf4-a8dc-93fecda5fb06 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:27.422101 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-145cd1ae-c7a1-4cf4-a8dc-93fecda5fb06 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:27.422989 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-145cd1ae-c7a1-4cf4-a8dc-93fecda5fb06 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:27.424309 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-145cd1ae-c7a1-4cf4-a8dc-93fecda5fb06 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:27.424909 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-145cd1ae-c7a1-4cf4-a8dc-93fecda5fb06 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:27.502885 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-277402e2-41a2-4e85-959c-01ca31fe9e7b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:27.503827 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-277402e2-41a2-4e85-959c-01ca31fe9e7b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:27.511877 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-277402e2-41a2-4e85-959c-01ca31fe9e7b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:27.512855 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-277402e2-41a2-4e85-959c-01ca31fe9e7b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:27.514102 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-277402e2-41a2-4e85-959c-01ca31fe9e7b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:27.514976 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-277402e2-41a2-4e85-959c-01ca31fe9e7b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:27.607873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-145cd1ae-c7a1-4cf4-a8dc-93fecda5fb06 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:27.615666 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-145cd1ae-c7a1-4cf4-a8dc-93fecda5fb06 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1367 microversion: 2.1 time: 0.206087 Jul 20 08:31:27.616247 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 325/670] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:27 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:27.724760 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-40e2e0a9-474b-4036-8d48-312dcd6b4d0f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:27.726063 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-40e2e0a9-474b-4036-8d48-312dcd6b4d0f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:27.733635 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-40e2e0a9-474b-4036-8d48-312dcd6b4d0f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:27.734403 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-40e2e0a9-474b-4036-8d48-312dcd6b4d0f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:27.735640 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-40e2e0a9-474b-4036-8d48-312dcd6b4d0f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:27.736293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-40e2e0a9-474b-4036-8d48-312dcd6b4d0f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:27.792457 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-277402e2-41a2-4e85-959c-01ca31fe9e7b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:27.799265 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:27.803600 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-277402e2-41a2-4e85-959c-01ca31fe9e7b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.306932 Jul 20 08:31:27.804500 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 346/671] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:27 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:27.886323 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-40e2e0a9-474b-4036-8d48-312dcd6b4d0f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:27.894374 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-40e2e0a9-474b-4036-8d48-312dcd6b4d0f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:27.895979 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-40e2e0a9-474b-4036-8d48-312dcd6b4d0f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:27.897305 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-40e2e0a9-474b-4036-8d48-312dcd6b4d0f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1741 microversion: 2.20 time: 0.176723 Jul 20 08:31:27.909206 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 326/672] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:27 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:31:28.394831 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5b42eaa8-6a60-4645-83b5-5d683df6bf97 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:28.395558 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5b42eaa8-6a60-4645-83b5-5d683df6bf97 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:28.402227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5b42eaa8-6a60-4645-83b5-5d683df6bf97 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:28.402773 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5b42eaa8-6a60-4645-83b5-5d683df6bf97 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:28.403598 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5b42eaa8-6a60-4645-83b5-5d683df6bf97 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:28.404094 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5b42eaa8-6a60-4645-83b5-5d683df6bf97 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:28.555199 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5b42eaa8-6a60-4645-83b5-5d683df6bf97 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:28.564180 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5b42eaa8-6a60-4645-83b5-5d683df6bf97 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1723 microversion: 2.1 time: 0.173511 Jul 20 08:31:28.564755 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 347/673] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:28 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:28.633399 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1f6832cd-06e6-43d4-9011-9c2e655c228f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:28.634303 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1f6832cd-06e6-43d4-9011-9c2e655c228f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:28.641322 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1f6832cd-06e6-43d4-9011-9c2e655c228f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:28.641929 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1f6832cd-06e6-43d4-9011-9c2e655c228f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:28.642974 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1f6832cd-06e6-43d4-9011-9c2e655c228f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:28.644142 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1f6832cd-06e6-43d4-9011-9c2e655c228f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:28.797165 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1f6832cd-06e6-43d4-9011-9c2e655c228f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:28.805819 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1f6832cd-06e6-43d4-9011-9c2e655c228f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1367 microversion: 2.1 time: 0.176219 Jul 20 08:31:28.807210 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 327/674] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:28 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:28.821836 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-78ffec91-b592-49ef-a405-eb6aa064dfd4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:28.822511 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-78ffec91-b592-49ef-a405-eb6aa064dfd4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:28.840626 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-78ffec91-b592-49ef-a405-eb6aa064dfd4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:28.841347 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-78ffec91-b592-49ef-a405-eb6aa064dfd4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:28.842162 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-78ffec91-b592-49ef-a405-eb6aa064dfd4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:28.842648 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-78ffec91-b592-49ef-a405-eb6aa064dfd4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:28.917398 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b3984b8d-a586-4a46-85ff-8b5e7782673d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:28.917973 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b3984b8d-a586-4a46-85ff-8b5e7782673d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:28.924355 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b3984b8d-a586-4a46-85ff-8b5e7782673d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:28.924994 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b3984b8d-a586-4a46-85ff-8b5e7782673d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:28.925975 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b3984b8d-a586-4a46-85ff-8b5e7782673d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:28.926572 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b3984b8d-a586-4a46-85ff-8b5e7782673d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:28.991251 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-78ffec91-b592-49ef-a405-eb6aa064dfd4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:28.999410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-78ffec91-b592-49ef-a405-eb6aa064dfd4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.181522 Jul 20 08:31:29.001624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 348/675] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:28 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:29.110779 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b3984b8d-a586-4a46-85ff-8b5e7782673d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:29.121993 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b3984b8d-a586-4a46-85ff-8b5e7782673d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:29.123597 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b3984b8d-a586-4a46-85ff-8b5e7782673d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:29.124933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b3984b8d-a586-4a46-85ff-8b5e7782673d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1741 microversion: 2.20 time: 0.212003 Jul 20 08:31:29.125499 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 328/676] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:28 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1741 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:31:29.581460 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-25ca43b6-33e7-4503-abe9-1ccc5bd797d8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:29.582093 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-25ca43b6-33e7-4503-abe9-1ccc5bd797d8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:29.588947 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-25ca43b6-33e7-4503-abe9-1ccc5bd797d8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:29.589397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-25ca43b6-33e7-4503-abe9-1ccc5bd797d8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:29.590198 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-25ca43b6-33e7-4503-abe9-1ccc5bd797d8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:29.590664 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-25ca43b6-33e7-4503-abe9-1ccc5bd797d8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:29.734183 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-25ca43b6-33e7-4503-abe9-1ccc5bd797d8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:29.742326 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-25ca43b6-33e7-4503-abe9-1ccc5bd797d8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1723 microversion: 2.1 time: 0.164910 Jul 20 08:31:29.747713 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 349/677] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:29 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:29.824680 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-65e89daa-3710-42e3-a7ac-85c2d2823e2c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:29.826003 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-65e89daa-3710-42e3-a7ac-85c2d2823e2c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:29.842378 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-65e89daa-3710-42e3-a7ac-85c2d2823e2c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:29.842925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-65e89daa-3710-42e3-a7ac-85c2d2823e2c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:29.846319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-65e89daa-3710-42e3-a7ac-85c2d2823e2c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:29.847285 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-65e89daa-3710-42e3-a7ac-85c2d2823e2c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:30.017447 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-0f2b1305-77c3-4e8f-ab54-ac90f609872c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:30.023347 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-0f2b1305-77c3-4e8f-ab54-ac90f609872c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:30.034851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0f2b1305-77c3-4e8f-ab54-ac90f609872c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:30.035300 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0f2b1305-77c3-4e8f-ab54-ac90f609872c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:30.036095 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0f2b1305-77c3-4e8f-ab54-ac90f609872c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:30.036535 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0f2b1305-77c3-4e8f-ab54-ac90f609872c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:30.058122 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-65e89daa-3710-42e3-a7ac-85c2d2823e2c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:30.066734 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-65e89daa-3710-42e3-a7ac-85c2d2823e2c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1367 microversion: 2.1 time: 0.246663 Jul 20 08:31:30.070468 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 329/678] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:29 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:30.144165 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f6226d68-8c90-4803-bce5-19163c9221a1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:30.144772 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f6226d68-8c90-4803-bce5-19163c9221a1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:30.152251 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f6226d68-8c90-4803-bce5-19163c9221a1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:30.152715 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f6226d68-8c90-4803-bce5-19163c9221a1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:30.153563 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f6226d68-8c90-4803-bce5-19163c9221a1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:30.154038 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f6226d68-8c90-4803-bce5-19163c9221a1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:30.172820 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=2 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:30.200419 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0f2b1305-77c3-4e8f-ab54-ac90f609872c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:30.209586 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-0f2b1305-77c3-4e8f-ab54-ac90f609872c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.195602 Jul 20 08:31:30.210008 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 350/679] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:30 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:30.309866 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f6226d68-8c90-4803-bce5-19163c9221a1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:30.334760 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f6226d68-8c90-4803-bce5-19163c9221a1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:30.340004 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f6226d68-8c90-4803-bce5-19163c9221a1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:30.342005 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f6226d68-8c90-4803-bce5-19163c9221a1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1741 microversion: 2.20 time: 0.201804 Jul 20 08:31:30.342876 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 330/680] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:30 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1741 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:31:30.760398 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3f2faba3-9f3a-40d1-b3ba-ee35038a50bc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:30.761651 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3f2faba3-9f3a-40d1-b3ba-ee35038a50bc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:30.768751 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3f2faba3-9f3a-40d1-b3ba-ee35038a50bc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:30.769459 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3f2faba3-9f3a-40d1-b3ba-ee35038a50bc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:30.770238 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3f2faba3-9f3a-40d1-b3ba-ee35038a50bc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:30.770709 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3f2faba3-9f3a-40d1-b3ba-ee35038a50bc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:30.917116 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3f2faba3-9f3a-40d1-b3ba-ee35038a50bc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:30.925709 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3f2faba3-9f3a-40d1-b3ba-ee35038a50bc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1723 microversion: 2.1 time: 0.169808 Jul 20 08:31:30.926365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 351/681] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:30 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:31.085847 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ce0fb6a0-f514-42b8-9130-a95a26ae8936 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:31.086476 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ce0fb6a0-f514-42b8-9130-a95a26ae8936 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:31.093419 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ce0fb6a0-f514-42b8-9130-a95a26ae8936 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:31.093870 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ce0fb6a0-f514-42b8-9130-a95a26ae8936 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:31.094672 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ce0fb6a0-f514-42b8-9130-a95a26ae8936 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:31.094672 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ce0fb6a0-f514-42b8-9130-a95a26ae8936 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:31.228337 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e008def3-0298-4e5b-a896-9d84707f6d2b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:31.229192 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e008def3-0298-4e5b-a896-9d84707f6d2b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:31.234284 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ce0fb6a0-f514-42b8-9130-a95a26ae8936 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:31.235695 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e008def3-0298-4e5b-a896-9d84707f6d2b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:31.236141 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e008def3-0298-4e5b-a896-9d84707f6d2b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:31.236926 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e008def3-0298-4e5b-a896-9d84707f6d2b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:31.237367 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e008def3-0298-4e5b-a896-9d84707f6d2b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:31.237882 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:31.242894 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ce0fb6a0-f514-42b8-9130-a95a26ae8936 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1367 microversion: 2.1 time: 0.160778 Jul 20 08:31:31.243557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 331/682] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:31 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:31.361612 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-540c77e7-1844-4084-a28f-da838e0c3ef8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:31.362216 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-540c77e7-1844-4084-a28f-da838e0c3ef8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:31.369347 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-540c77e7-1844-4084-a28f-da838e0c3ef8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:31.369678 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-540c77e7-1844-4084-a28f-da838e0c3ef8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:31.370463 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-540c77e7-1844-4084-a28f-da838e0c3ef8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:31.370998 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-540c77e7-1844-4084-a28f-da838e0c3ef8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:31.372184 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e008def3-0298-4e5b-a896-9d84707f6d2b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:31.379724 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e008def3-0298-4e5b-a896-9d84707f6d2b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.155858 Jul 20 08:31:31.380286 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 352/683] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:31 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:31.503774 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-540c77e7-1844-4084-a28f-da838e0c3ef8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:31.512773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-540c77e7-1844-4084-a28f-da838e0c3ef8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:31.514381 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-540c77e7-1844-4084-a28f-da838e0c3ef8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:31.515554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-540c77e7-1844-4084-a28f-da838e0c3ef8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1741 microversion: 2.20 time: 0.158472 Jul 20 08:31:31.516114 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 332/684] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:31 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:31:31.943440 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d50c56e2-bc20-4742-a4c5-1f30cf8b7a95 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:31.944081 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d50c56e2-bc20-4742-a4c5-1f30cf8b7a95 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:31.951678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d50c56e2-bc20-4742-a4c5-1f30cf8b7a95 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:31.952148 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d50c56e2-bc20-4742-a4c5-1f30cf8b7a95 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:31.952935 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d50c56e2-bc20-4742-a4c5-1f30cf8b7a95 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:31.953366 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d50c56e2-bc20-4742-a4c5-1f30cf8b7a95 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:32.116827 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d50c56e2-bc20-4742-a4c5-1f30cf8b7a95 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:32.125465 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d50c56e2-bc20-4742-a4c5-1f30cf8b7a95 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1723 microversion: 2.1 time: 0.185928 Jul 20 08:31:32.126035 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 353/685] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:31 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:32.262093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-4233b9ef-ed8e-48a5-be92-5168079befba tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:32.262656 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-4233b9ef-ed8e-48a5-be92-5168079befba tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:32.269823 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4233b9ef-ed8e-48a5-be92-5168079befba tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:32.270271 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4233b9ef-ed8e-48a5-be92-5168079befba tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:32.271085 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4233b9ef-ed8e-48a5-be92-5168079befba tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:32.271520 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4233b9ef-ed8e-48a5-be92-5168079befba tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:32.397538 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-59f1991d-72a0-4fc1-992c-96bc1ae4f981 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:32.398151 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-59f1991d-72a0-4fc1-992c-96bc1ae4f981 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:32.404482 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-59f1991d-72a0-4fc1-992c-96bc1ae4f981 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:32.404923 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-59f1991d-72a0-4fc1-992c-96bc1ae4f981 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:32.405881 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-59f1991d-72a0-4fc1-992c-96bc1ae4f981 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:32.406303 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-59f1991d-72a0-4fc1-992c-96bc1ae4f981 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:32.409660 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-4233b9ef-ed8e-48a5-be92-5168079befba tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:32.422563 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-4233b9ef-ed8e-48a5-be92-5168079befba tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1367 microversion: 2.1 time: 0.164972 Jul 20 08:31:32.423409 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 333/686] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:32 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:32.534981 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1e6cc524-abe4-4449-8c14-c37c177c7d5a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:32.535319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1e6cc524-abe4-4449-8c14-c37c177c7d5a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:32.542224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1e6cc524-abe4-4449-8c14-c37c177c7d5a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:32.542697 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1e6cc524-abe4-4449-8c14-c37c177c7d5a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:32.543479 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1e6cc524-abe4-4449-8c14-c37c177c7d5a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:32.543915 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1e6cc524-abe4-4449-8c14-c37c177c7d5a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:32.687442 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1e6cc524-abe4-4449-8c14-c37c177c7d5a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:32.695959 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1e6cc524-abe4-4449-8c14-c37c177c7d5a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:32.697705 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1e6cc524-abe4-4449-8c14-c37c177c7d5a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:32.698893 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1e6cc524-abe4-4449-8c14-c37c177c7d5a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1741 microversion: 2.20 time: 0.168156 Jul 20 08:31:32.699460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 334/687] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:32 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:31:32.784325 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-59f1991d-72a0-4fc1-992c-96bc1ae4f981 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:32.793063 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-59f1991d-72a0-4fc1-992c-96bc1ae4f981 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.399366 Jul 20 08:31:32.793555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 354/688] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:32 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:33.142538 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8f83bd74-2bd8-4bc5-9d3c-bf267c9fa7cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:33.143159 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8f83bd74-2bd8-4bc5-9d3c-bf267c9fa7cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:33.149214 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8f83bd74-2bd8-4bc5-9d3c-bf267c9fa7cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:33.150404 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8f83bd74-2bd8-4bc5-9d3c-bf267c9fa7cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:33.151381 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8f83bd74-2bd8-4bc5-9d3c-bf267c9fa7cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:33.151817 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8f83bd74-2bd8-4bc5-9d3c-bf267c9fa7cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:33.291394 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-8f83bd74-2bd8-4bc5-9d3c-bf267c9fa7cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:33.299485 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8f83bd74-2bd8-4bc5-9d3c-bf267c9fa7cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1700 microversion: 2.1 time: 0.160713 Jul 20 08:31:33.299919 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 335/689] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:33 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1700 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:33.315428 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e49c8484-b719-4672-ad82-025cfce28bda tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:33.322462 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e49c8484-b719-4672-ad82-025cfce28bda tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:33.322949 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e49c8484-b719-4672-ad82-025cfce28bda tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:33.381843 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e49c8484-b719-4672-ad82-025cfce28bda tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Going to try to start instance {{(pid=117829) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 08:31:33.425560 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e49c8484-b719-4672-ad82-025cfce28bda tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "POST /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc/action" status: 202 len: 0 microversion: 2.1 time: 0.113650 Jul 20 08:31:33.426202 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 355/690] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Jul 20 08:31:33 2022] POST /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:31:33.434898 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-4fe6e483-fa0f-49d4-94d8-7682f2980b45 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:33.435509 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-4fe6e483-fa0f-49d4-94d8-7682f2980b45 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:33.440900 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-912105d1-5a9e-4489-a24b-7a95c48e0892 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:33.441612 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-912105d1-5a9e-4489-a24b-7a95c48e0892 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:33.441764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4fe6e483-fa0f-49d4-94d8-7682f2980b45 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:33.442178 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4fe6e483-fa0f-49d4-94d8-7682f2980b45 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:33.442983 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4fe6e483-fa0f-49d4-94d8-7682f2980b45 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:33.443420 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4fe6e483-fa0f-49d4-94d8-7682f2980b45 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:33.449080 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-912105d1-5a9e-4489-a24b-7a95c48e0892 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:33.449532 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-912105d1-5a9e-4489-a24b-7a95c48e0892 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:33.450319 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-912105d1-5a9e-4489-a24b-7a95c48e0892 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:33.450867 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-912105d1-5a9e-4489-a24b-7a95c48e0892 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:33.538569 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=2 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:33.590986 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-4fe6e483-fa0f-49d4-94d8-7682f2980b45 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:33.599151 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-4fe6e483-fa0f-49d4-94d8-7682f2980b45 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1709 microversion: 2.1 time: 0.168625 Jul 20 08:31:33.600011 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 336/691] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:33 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1709 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:33.616189 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-912105d1-5a9e-4489-a24b-7a95c48e0892 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:33.624698 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-912105d1-5a9e-4489-a24b-7a95c48e0892 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1367 microversion: 2.1 time: 0.188051 Jul 20 08:31:33.625275 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 356/692] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:33 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:33.717442 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ea4b3994-a8b0-49ce-ade3-ea795b98aac6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:33.718050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ea4b3994-a8b0-49ce-ade3-ea795b98aac6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:33.723994 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ea4b3994-a8b0-49ce-ade3-ea795b98aac6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:33.724430 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ea4b3994-a8b0-49ce-ade3-ea795b98aac6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:33.725176 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ea4b3994-a8b0-49ce-ade3-ea795b98aac6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:33.725602 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ea4b3994-a8b0-49ce-ade3-ea795b98aac6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:33.813485 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a0e5ecb0-bb87-42ba-8488-7fdcf9491c1f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:33.814278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a0e5ecb0-bb87-42ba-8488-7fdcf9491c1f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:33.816574 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:33.824198 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a0e5ecb0-bb87-42ba-8488-7fdcf9491c1f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:33.824761 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a0e5ecb0-bb87-42ba-8488-7fdcf9491c1f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:33.826107 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a0e5ecb0-bb87-42ba-8488-7fdcf9491c1f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:33.827328 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a0e5ecb0-bb87-42ba-8488-7fdcf9491c1f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:33.861634 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ea4b3994-a8b0-49ce-ade3-ea795b98aac6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:33.870324 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ea4b3994-a8b0-49ce-ade3-ea795b98aac6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:33.871872 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ea4b3994-a8b0-49ce-ade3-ea795b98aac6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:33.873037 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ea4b3994-a8b0-49ce-ade3-ea795b98aac6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1741 microversion: 2.20 time: 0.159513 Jul 20 08:31:33.873606 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 337/693] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:33 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1741 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:33.937910 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=12 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:33.964111 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a0e5ecb0-bb87-42ba-8488-7fdcf9491c1f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:33.971590 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a0e5ecb0-bb87-42ba-8488-7fdcf9491c1f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.165164 Jul 20 08:31:33.972164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 357/694] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:33 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:34.617160 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e7389484-e64d-4dfa-b8ed-9f612e0a0f7b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:34.617768 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-e7389484-e64d-4dfa-b8ed-9f612e0a0f7b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:34.624701 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e7389484-e64d-4dfa-b8ed-9f612e0a0f7b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:34.625069 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e7389484-e64d-4dfa-b8ed-9f612e0a0f7b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:34.625878 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e7389484-e64d-4dfa-b8ed-9f612e0a0f7b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:34.626311 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e7389484-e64d-4dfa-b8ed-9f612e0a0f7b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:34.641691 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-72ac822d-df89-4d47-9231-bb839b835541 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:34.642306 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-72ac822d-df89-4d47-9231-bb839b835541 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:34.649701 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-72ac822d-df89-4d47-9231-bb839b835541 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:34.650907 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-72ac822d-df89-4d47-9231-bb839b835541 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:34.651855 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-72ac822d-df89-4d47-9231-bb839b835541 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:34.652286 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-72ac822d-df89-4d47-9231-bb839b835541 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:34.773618 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e7389484-e64d-4dfa-b8ed-9f612e0a0f7b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:34.782690 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e7389484-e64d-4dfa-b8ed-9f612e0a0f7b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1709 microversion: 2.1 time: 0.169231 Jul 20 08:31:34.783384 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 338/695] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:34 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1709 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:34.799144 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-72ac822d-df89-4d47-9231-bb839b835541 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:34.806645 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-72ac822d-df89-4d47-9231-bb839b835541 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1367 microversion: 2.1 time: 0.168608 Jul 20 08:31:34.807130 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 358/696] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:34 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:34.891605 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ed5b872c-83b2-4917-9ecc-3e88ec77b737 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:34.892122 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ed5b872c-83b2-4917-9ecc-3e88ec77b737 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:34.898072 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ed5b872c-83b2-4917-9ecc-3e88ec77b737 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:34.898526 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ed5b872c-83b2-4917-9ecc-3e88ec77b737 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:34.899322 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ed5b872c-83b2-4917-9ecc-3e88ec77b737 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:34.900381 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ed5b872c-83b2-4917-9ecc-3e88ec77b737 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:34.989625 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-446d844e-6488-4722-b5dc-9204347f0d2d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:34.990383 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-446d844e-6488-4722-b5dc-9204347f0d2d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:34.997338 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-446d844e-6488-4722-b5dc-9204347f0d2d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:34.997781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-446d844e-6488-4722-b5dc-9204347f0d2d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:34.998537 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-446d844e-6488-4722-b5dc-9204347f0d2d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:34.998986 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-446d844e-6488-4722-b5dc-9204347f0d2d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:35.034973 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ed5b872c-83b2-4917-9ecc-3e88ec77b737 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:35.043868 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ed5b872c-83b2-4917-9ecc-3e88ec77b737 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:35.045363 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ed5b872c-83b2-4917-9ecc-3e88ec77b737 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:35.046513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ed5b872c-83b2-4917-9ecc-3e88ec77b737 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1741 microversion: 2.20 time: 0.158954 Jul 20 08:31:35.047182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 339/697] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:34 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:35.135528 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-446d844e-6488-4722-b5dc-9204347f0d2d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:35.143078 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-446d844e-6488-4722-b5dc-9204347f0d2d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.157817 Jul 20 08:31:35.143582 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 359/698] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:34 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:35.801544 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-63916824-2a22-4450-afed-543ffe21ddea tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:35.802202 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-63916824-2a22-4450-afed-543ffe21ddea tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:35.812655 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-63916824-2a22-4450-afed-543ffe21ddea tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:35.813106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-63916824-2a22-4450-afed-543ffe21ddea tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:35.813923 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-63916824-2a22-4450-afed-543ffe21ddea tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:35.814337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-63916824-2a22-4450-afed-543ffe21ddea tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:35.823999 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-05815529-7b1a-40d3-976f-b575a85e6876 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:35.824617 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-05815529-7b1a-40d3-976f-b575a85e6876 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:35.831103 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-05815529-7b1a-40d3-976f-b575a85e6876 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:35.831556 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-05815529-7b1a-40d3-976f-b575a85e6876 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:35.832353 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-05815529-7b1a-40d3-976f-b575a85e6876 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:35.832781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-05815529-7b1a-40d3-976f-b575a85e6876 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:35.993455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-05815529-7b1a-40d3-976f-b575a85e6876 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:36.001608 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-05815529-7b1a-40d3-976f-b575a85e6876 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1367 microversion: 2.1 time: 0.181433 Jul 20 08:31:36.002195 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 360/699] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:35 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:36.012070 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-63916824-2a22-4450-afed-543ffe21ddea tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:36.023731 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-63916824-2a22-4450-afed-543ffe21ddea tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1709 microversion: 2.1 time: 0.225528 Jul 20 08:31:36.024543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 340/700] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:35 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1709 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:36.066756 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-43bf5e3a-73c7-4d2f-9562-a80643e74d88 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:36.068007 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-43bf5e3a-73c7-4d2f-9562-a80643e74d88 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:36.075376 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-43bf5e3a-73c7-4d2f-9562-a80643e74d88 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:36.075919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-43bf5e3a-73c7-4d2f-9562-a80643e74d88 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:36.076746 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-43bf5e3a-73c7-4d2f-9562-a80643e74d88 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:36.077171 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-43bf5e3a-73c7-4d2f-9562-a80643e74d88 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:36.161021 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e628c9af-57c5-4af7-89d4-d5cf201d5863 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:36.161633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-e628c9af-57c5-4af7-89d4-d5cf201d5863 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:36.168116 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e628c9af-57c5-4af7-89d4-d5cf201d5863 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:36.168592 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e628c9af-57c5-4af7-89d4-d5cf201d5863 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:36.169678 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e628c9af-57c5-4af7-89d4-d5cf201d5863 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:36.170246 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e628c9af-57c5-4af7-89d4-d5cf201d5863 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:36.308161 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e628c9af-57c5-4af7-89d4-d5cf201d5863 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:36.315850 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e628c9af-57c5-4af7-89d4-d5cf201d5863 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.159301 Jul 20 08:31:36.316636 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 341/701] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:36 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:36.469790 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-43bf5e3a-73c7-4d2f-9562-a80643e74d88 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:36.477745 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-43bf5e3a-73c7-4d2f-9562-a80643e74d88 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:36.479255 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-43bf5e3a-73c7-4d2f-9562-a80643e74d88 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:36.480404 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-43bf5e3a-73c7-4d2f-9562-a80643e74d88 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1723 microversion: 2.20 time: 0.419111 Jul 20 08:31:36.480980 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 361/702] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:36 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1723 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:36.889814 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-05f728af-c302-4db9-b1e1-6573a1717728 req-20d49249-5b93-4343-886b-7b73565a152e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28eb9e1d-9ca5-43a1-8330-ae91249f609c", "name": "network-vif-plugged", "status": "completed", "tag": "70393be6-628d-4634-90f4-13212f783bcf"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:36.899701 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-05f728af-c302-4db9-b1e1-6573a1717728 req-20d49249-5b93-4343-886b-7b73565a152e service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:36.900142 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-05f728af-c302-4db9-b1e1-6573a1717728 req-20d49249-5b93-4343-886b-7b73565a152e service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:36.913981 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-05f728af-c302-4db9-b1e1-6573a1717728 req-20d49249-5b93-4343-886b-7b73565a152e service nova] Creating event network-vif-plugged:70393be6-628d-4634-90f4-13212f783bcf for instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c on hv-cinder-82308 Jul 20 08:31:36.919509 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-05f728af-c302-4db9-b1e1-6573a1717728 req-20d49249-5b93-4343-886b-7b73565a152e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034214 Jul 20 08:31:36.920105 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 342/703] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:31:37.019806 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c4294294-ca47-403d-bab7-3ffa9531f0bb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:37.020417 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c4294294-ca47-403d-bab7-3ffa9531f0bb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:37.027712 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c4294294-ca47-403d-bab7-3ffa9531f0bb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:37.028163 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c4294294-ca47-403d-bab7-3ffa9531f0bb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:37.028962 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c4294294-ca47-403d-bab7-3ffa9531f0bb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:37.029408 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c4294294-ca47-403d-bab7-3ffa9531f0bb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:37.042735 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-eab35956-4bc6-489d-b449-2d538e177603 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:37.043434 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-eab35956-4bc6-489d-b449-2d538e177603 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:37.050342 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:37.065714 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eab35956-4bc6-489d-b449-2d538e177603 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:37.066951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eab35956-4bc6-489d-b449-2d538e177603 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:37.067959 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eab35956-4bc6-489d-b449-2d538e177603 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:37.068554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eab35956-4bc6-489d-b449-2d538e177603 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:37.233749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-eab35956-4bc6-489d-b449-2d538e177603 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:37.242059 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-eab35956-4bc6-489d-b449-2d538e177603 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1709 microversion: 2.1 time: 0.203564 Jul 20 08:31:37.242803 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 343/704] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:37 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1709 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:37.248568 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-aeaa6560-b4ad-453b-bcb3-623faf3e6236 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:37.249619 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-aeaa6560-b4ad-453b-bcb3-623faf3e6236 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:37.255717 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aeaa6560-b4ad-453b-bcb3-623faf3e6236 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:37.256257 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aeaa6560-b4ad-453b-bcb3-623faf3e6236 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:37.257082 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aeaa6560-b4ad-453b-bcb3-623faf3e6236 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:37.257512 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aeaa6560-b4ad-453b-bcb3-623faf3e6236 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:37.316952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c4294294-ca47-403d-bab7-3ffa9531f0bb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:37.343135 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c4294294-ca47-403d-bab7-3ffa9531f0bb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1367 microversion: 2.1 time: 0.327020 Jul 20 08:31:37.344996 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 362/705] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:37 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1367 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:37.350968 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f55419d9-4694-4a6d-a2b8-4c7c8203258f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:37.351771 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f55419d9-4694-4a6d-a2b8-4c7c8203258f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:37.358120 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f55419d9-4694-4a6d-a2b8-4c7c8203258f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:37.358570 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f55419d9-4694-4a6d-a2b8-4c7c8203258f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:37.359741 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f55419d9-4694-4a6d-a2b8-4c7c8203258f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:37.360182 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f55419d9-4694-4a6d-a2b8-4c7c8203258f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:37.502975 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f55419d9-4694-4a6d-a2b8-4c7c8203258f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:37.512249 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f55419d9-4694-4a6d-a2b8-4c7c8203258f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.165395 Jul 20 08:31:37.512937 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 363/706] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:37 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:37.517796 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-2bb157dd-12cf-4a78-9e6e-e175e4279096 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:37.518479 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-2bb157dd-12cf-4a78-9e6e-e175e4279096 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:37.525171 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2bb157dd-12cf-4a78-9e6e-e175e4279096 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:37.525883 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2bb157dd-12cf-4a78-9e6e-e175e4279096 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:37.526828 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2bb157dd-12cf-4a78-9e6e-e175e4279096 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:37.527262 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2bb157dd-12cf-4a78-9e6e-e175e4279096 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:37.627554 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-aeaa6560-b4ad-453b-bcb3-623faf3e6236 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:37.636198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-aeaa6560-b4ad-453b-bcb3-623faf3e6236 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1592 microversion: 2.1 time: 0.391773 Jul 20 08:31:37.636782 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 344/707] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:37 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1592 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:37.674478 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-2bb157dd-12cf-4a78-9e6e-e175e4279096 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:37.683805 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-2bb157dd-12cf-4a78-9e6e-e175e4279096 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:37.685356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-2bb157dd-12cf-4a78-9e6e-e175e4279096 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:37.686533 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-2bb157dd-12cf-4a78-9e6e-e175e4279096 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1723 microversion: 2.20 time: 0.172678 Jul 20 08:31:37.687199 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 364/708] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:37 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:38.261407 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7b4efbda-abef-4abe-a553-b7a05305252f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:38.261968 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-7b4efbda-abef-4abe-a553-b7a05305252f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:38.268745 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7b4efbda-abef-4abe-a553-b7a05305252f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:38.269250 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7b4efbda-abef-4abe-a553-b7a05305252f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:38.270033 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7b4efbda-abef-4abe-a553-b7a05305252f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:38.270494 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7b4efbda-abef-4abe-a553-b7a05305252f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:38.362062 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-545102ad-a648-45af-945e-25114d30648c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:38.362797 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-545102ad-a648-45af-945e-25114d30648c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:38.369577 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-545102ad-a648-45af-945e-25114d30648c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:38.371369 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-545102ad-a648-45af-945e-25114d30648c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:38.371369 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-545102ad-a648-45af-945e-25114d30648c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:38.371369 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-545102ad-a648-45af-945e-25114d30648c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:38.504406 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-7b4efbda-abef-4abe-a553-b7a05305252f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:38.513601 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-7b4efbda-abef-4abe-a553-b7a05305252f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1709 microversion: 2.1 time: 0.257387 Jul 20 08:31:38.514813 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 345/709] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:38 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1709 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:38.530597 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-327e5038-cad7-4e14-9ce9-8af84f21d0dc tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:38.531504 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-327e5038-cad7-4e14-9ce9-8af84f21d0dc tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:38.538922 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-327e5038-cad7-4e14-9ce9-8af84f21d0dc tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:38.539377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-327e5038-cad7-4e14-9ce9-8af84f21d0dc tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:38.540204 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-327e5038-cad7-4e14-9ce9-8af84f21d0dc tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:38.540738 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-327e5038-cad7-4e14-9ce9-8af84f21d0dc tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:38.590171 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-545102ad-a648-45af-945e-25114d30648c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:38.598039 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-545102ad-a648-45af-945e-25114d30648c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1367 microversion: 2.1 time: 0.240038 Jul 20 08:31:38.598807 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 365/710] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:38 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:38.704583 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9a9f9931-b48e-4a06-912b-16eba22470e8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:38.705379 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9a9f9931-b48e-4a06-912b-16eba22470e8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:38.711473 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9a9f9931-b48e-4a06-912b-16eba22470e8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:38.711919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9a9f9931-b48e-4a06-912b-16eba22470e8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:38.712720 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9a9f9931-b48e-4a06-912b-16eba22470e8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:38.713396 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9a9f9931-b48e-4a06-912b-16eba22470e8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:38.761341 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-327e5038-cad7-4e14-9ce9-8af84f21d0dc tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:38.769982 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-327e5038-cad7-4e14-9ce9-8af84f21d0dc tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.243121 Jul 20 08:31:38.770899 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 346/711] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:38 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:38.858822 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9a9f9931-b48e-4a06-912b-16eba22470e8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:38.868016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9a9f9931-b48e-4a06-912b-16eba22470e8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:38.870377 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9a9f9931-b48e-4a06-912b-16eba22470e8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:38.871583 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9a9f9931-b48e-4a06-912b-16eba22470e8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1723 microversion: 2.20 time: 0.170867 Jul 20 08:31:38.878568 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 366/712] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:38 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:31:39.531859 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-6b53995e-2294-41cb-8c3e-84b890def8bf tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:39.532479 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-6b53995e-2294-41cb-8c3e-84b890def8bf tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:39.544285 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6b53995e-2294-41cb-8c3e-84b890def8bf tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:39.544718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6b53995e-2294-41cb-8c3e-84b890def8bf tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:39.545508 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6b53995e-2294-41cb-8c3e-84b890def8bf tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:39.546139 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6b53995e-2294-41cb-8c3e-84b890def8bf tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:39.653410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-26c670aa-1eae-47f2-b09a-ba37872dca74 req-434540b7-37ba-4c33-b51f-fff3946ddcf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a437f068-8b36-411d-ab25-a00ec30b71de", "tag": "26b6ab63-8e74-43dc-82a1-e3067592fa61"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:39.664614 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-26c670aa-1eae-47f2-b09a-ba37872dca74 req-434540b7-37ba-4c33-b51f-fff3946ddcf2 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:39.666327 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-26c670aa-1eae-47f2-b09a-ba37872dca74 req-434540b7-37ba-4c33-b51f-fff3946ddcf2 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:39.679512 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-26c670aa-1eae-47f2-b09a-ba37872dca74 req-434540b7-37ba-4c33-b51f-fff3946ddcf2 service nova] Creating event network-changed:26b6ab63-8e74-43dc-82a1-e3067592fa61 for instance a437f068-8b36-411d-ab25-a00ec30b71de on hv-cinder-82308 Jul 20 08:31:39.686099 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-26c670aa-1eae-47f2-b09a-ba37872dca74 req-434540b7-37ba-4c33-b51f-fff3946ddcf2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119482 Jul 20 08:31:39.687026 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 367/713] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:31:39.693256 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ba4f8e38-7ba9-43a5-9153-6b12f66ac886 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:39.694403 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ba4f8e38-7ba9-43a5-9153-6b12f66ac886 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:39.702284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ba4f8e38-7ba9-43a5-9153-6b12f66ac886 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:39.703159 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ba4f8e38-7ba9-43a5-9153-6b12f66ac886 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:39.704159 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ba4f8e38-7ba9-43a5-9153-6b12f66ac886 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:39.704759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ba4f8e38-7ba9-43a5-9153-6b12f66ac886 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:39.789406 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-6b53995e-2294-41cb-8c3e-84b890def8bf tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:39.799869 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-6b53995e-2294-41cb-8c3e-84b890def8bf tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1709 microversion: 2.1 time: 0.271823 Jul 20 08:31:39.801193 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 347/714] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:39 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1709 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:39.806434 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a9add1c7-0b57-4157-b9d4-f0bb288854f5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:39.807381 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a9add1c7-0b57-4157-b9d4-f0bb288854f5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:39.825261 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a9add1c7-0b57-4157-b9d4-f0bb288854f5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:39.826107 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a9add1c7-0b57-4157-b9d4-f0bb288854f5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:39.827169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a9add1c7-0b57-4157-b9d4-f0bb288854f5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:39.827862 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a9add1c7-0b57-4157-b9d4-f0bb288854f5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:39.923439 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ba4f8e38-7ba9-43a5-9153-6b12f66ac886 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:39.933728 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ba4f8e38-7ba9-43a5-9153-6b12f66ac886 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1367 microversion: 2.1 time: 0.245193 Jul 20 08:31:39.938465 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 368/715] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:39 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:39.948575 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6768e820-ecd3-423f-9af3-3f4297dbbdb0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:39.949279 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6768e820-ecd3-423f-9af3-3f4297dbbdb0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:39.956336 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6768e820-ecd3-423f-9af3-3f4297dbbdb0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:39.956914 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6768e820-ecd3-423f-9af3-3f4297dbbdb0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:39.957793 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6768e820-ecd3-423f-9af3-3f4297dbbdb0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:39.958509 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6768e820-ecd3-423f-9af3-3f4297dbbdb0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:40.161428 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6768e820-ecd3-423f-9af3-3f4297dbbdb0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:40.184557 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6768e820-ecd3-423f-9af3-3f4297dbbdb0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:40.188023 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a9add1c7-0b57-4157-b9d4-f0bb288854f5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:40.191659 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6768e820-ecd3-423f-9af3-3f4297dbbdb0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:40.193225 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6768e820-ecd3-423f-9af3-3f4297dbbdb0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1723 microversion: 2.20 time: 0.252548 Jul 20 08:31:40.205386 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a9add1c7-0b57-4157-b9d4-f0bb288854f5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.395616 Jul 20 08:31:40.205386 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 348/716] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:39 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:40.206462 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 369/717] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:39 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:40.828020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b6a5c7b0-a1ed-4a6d-b601-70c4e52ad215 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:40.829218 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b6a5c7b0-a1ed-4a6d-b601-70c4e52ad215 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:40.851895 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b6a5c7b0-a1ed-4a6d-b601-70c4e52ad215 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:40.853305 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b6a5c7b0-a1ed-4a6d-b601-70c4e52ad215 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:40.854424 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b6a5c7b0-a1ed-4a6d-b601-70c4e52ad215 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:40.856602 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b6a5c7b0-a1ed-4a6d-b601-70c4e52ad215 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:40.863805 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=100 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:40.997520 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-8b057433-a86b-4a17-ba12-82535b18052c req-d25795b5-8d41-4339-b4fc-02493925b2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b295e0-508c-4cd5-b18f-3b808c0ff265", "name": "network-vif-unplugged", "status": "completed", "tag": "25187f6d-a614-4168-94dd-d0c397aaf6f3"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:41.007480 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-8b057433-a86b-4a17-ba12-82535b18052c req-d25795b5-8d41-4339-b4fc-02493925b2f8 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:41.008301 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-8b057433-a86b-4a17-ba12-82535b18052c req-d25795b5-8d41-4339-b4fc-02493925b2f8 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:41.021725 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-8b057433-a86b-4a17-ba12-82535b18052c req-d25795b5-8d41-4339-b4fc-02493925b2f8 service nova] Creating event network-vif-unplugged:25187f6d-a614-4168-94dd-d0c397aaf6f3 for instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 on hv-cinder-82308 Jul 20 08:31:41.031256 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-8b057433-a86b-4a17-ba12-82535b18052c req-d25795b5-8d41-4339-b4fc-02493925b2f8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117392 Jul 20 08:31:41.032391 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 370/718] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:31:41.039753 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9bcea409-9f04-4709-9d76-9998d888a2c8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:41.041216 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9bcea409-9f04-4709-9d76-9998d888a2c8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:41.047990 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9bcea409-9f04-4709-9d76-9998d888a2c8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:41.048450 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9bcea409-9f04-4709-9d76-9998d888a2c8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:41.049470 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9bcea409-9f04-4709-9d76-9998d888a2c8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:41.049910 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9bcea409-9f04-4709-9d76-9998d888a2c8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:41.080008 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b6a5c7b0-a1ed-4a6d-b601-70c4e52ad215 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:41.090254 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b6a5c7b0-a1ed-4a6d-b601-70c4e52ad215 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1713 microversion: 2.1 time: 0.266070 Jul 20 08:31:41.090881 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 349/719] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:40 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1713 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:41.095904 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-82fb02ef-e456-4b55-8b12-24409dfe67d2 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-521191702"}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:41.096719 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-82fb02ef-e456-4b55-8b12-24409dfe67d2 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:41.106936 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-82fb02ef-e456-4b55-8b12-24409dfe67d2 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:41.107400 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-82fb02ef-e456-4b55-8b12-24409dfe67d2 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:41.108212 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-82fb02ef-e456-4b55-8b12-24409dfe67d2 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:41.108646 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-82fb02ef-e456-4b55-8b12-24409dfe67d2 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:41.201348 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9bcea409-9f04-4709-9d76-9998d888a2c8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:41.209675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9bcea409-9f04-4709-9d76-9998d888a2c8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1367 microversion: 2.1 time: 0.175849 Jul 20 08:31:41.210270 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 371/720] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:41 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:41.216437 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4f71ba95-0cf4-4b38-a8a1-25cb835aded3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:41.217441 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4f71ba95-0cf4-4b38-a8a1-25cb835aded3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:41.224518 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4f71ba95-0cf4-4b38-a8a1-25cb835aded3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:41.225082 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4f71ba95-0cf4-4b38-a8a1-25cb835aded3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:41.225954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4f71ba95-0cf4-4b38-a8a1-25cb835aded3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:41.226462 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4f71ba95-0cf4-4b38-a8a1-25cb835aded3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:41.271670 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.network.security_group_api [None req-82fb02ef-e456-4b55-8b12-24409dfe67d2 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Adding security group a997cc5b-0979-4200-9724-02c22d8b4826 to port 26b6ab63-8e74-43dc-82a1-e3067592fa61 Jul 20 08:31:41.372247 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4f71ba95-0cf4-4b38-a8a1-25cb835aded3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:41.380322 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4f71ba95-0cf4-4b38-a8a1-25cb835aded3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:41.381814 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4f71ba95-0cf4-4b38-a8a1-25cb835aded3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:41.382995 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4f71ba95-0cf4-4b38-a8a1-25cb835aded3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1723 microversion: 2.20 time: 0.171326 Jul 20 08:31:41.383559 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 372/721] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:41 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:41.389094 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-321e5408-cd08-456b-8d9b-d37ae0939cb2 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:41.389964 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-321e5408-cd08-456b-8d9b-d37ae0939cb2 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:41.395950 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-321e5408-cd08-456b-8d9b-d37ae0939cb2 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:41.396396 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-321e5408-cd08-456b-8d9b-d37ae0939cb2 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:41.397164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-321e5408-cd08-456b-8d9b-d37ae0939cb2 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:41.397593 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-321e5408-cd08-456b-8d9b-d37ae0939cb2 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:41.536604 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-321e5408-cd08-456b-8d9b-d37ae0939cb2 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:41.544351 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-321e5408-cd08-456b-8d9b-d37ae0939cb2 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.158942 Jul 20 08:31:41.545014 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 373/722] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:41 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:41.692990 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-82fb02ef-e456-4b55-8b12-24409dfe67d2 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "POST /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de/action" status: 202 len: 0 microversion: 2.1 time: 0.600810 Jul 20 08:31:41.693601 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 350/723] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Jul 20 08:31:41 2022] POST /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:31:41.702722 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5e6f976a-409f-4d66-bdc8-251c3cd309d1 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:41.703272 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-5e6f976a-409f-4d66-bdc8-251c3cd309d1 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:41.711118 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5e6f976a-409f-4d66-bdc8-251c3cd309d1 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:41.711569 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5e6f976a-409f-4d66-bdc8-251c3cd309d1 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:41.712400 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5e6f976a-409f-4d66-bdc8-251c3cd309d1 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:41.712838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5e6f976a-409f-4d66-bdc8-251c3cd309d1 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:41.819324 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-483eaeef-bd41-44c0-8c6b-6377f620b601 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5aa3260c-5736-488a-8d19-9b856cf84410"}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:41.820495 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-483eaeef-bd41-44c0-8c6b-6377f620b601 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:41.827522 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-483eaeef-bd41-44c0-8c6b-6377f620b601 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:41.827984 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-483eaeef-bd41-44c0-8c6b-6377f620b601 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:41.828762 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-483eaeef-bd41-44c0-8c6b-6377f620b601 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:41.829383 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-483eaeef-bd41-44c0-8c6b-6377f620b601 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:41.879259 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5e6f976a-409f-4d66-bdc8-251c3cd309d1 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:41.889306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-5e6f976a-409f-4d66-bdc8-251c3cd309d1 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1638 microversion: 2.1 time: 0.190417 Jul 20 08:31:41.890224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 351/724] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:41 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1638 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:41.894726 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-d0476c51-2f7b-46bb-acff-d413908b96a3 req-04ce354a-e68d-47a2-992f-2909067896cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a437f068-8b36-411d-ab25-a00ec30b71de", "tag": "26b6ab63-8e74-43dc-82a1-e3067592fa61"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:41.915766 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-d0476c51-2f7b-46bb-acff-d413908b96a3 req-04ce354a-e68d-47a2-992f-2909067896cd service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:41.916297 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-d0476c51-2f7b-46bb-acff-d413908b96a3 req-04ce354a-e68d-47a2-992f-2909067896cd service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:41.927909 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-d0476c51-2f7b-46bb-acff-d413908b96a3 req-04ce354a-e68d-47a2-992f-2909067896cd service nova] Creating event network-changed:26b6ab63-8e74-43dc-82a1-e3067592fa61 for instance a437f068-8b36-411d-ab25-a00ec30b71de on hv-cinder-82308 Jul 20 08:31:41.933816 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-d0476c51-2f7b-46bb-acff-d413908b96a3 req-04ce354a-e68d-47a2-992f-2909067896cd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042340 Jul 20 08:31:41.934517 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 352/725] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:31:42.230369 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-36a4f9fd-2948-4edf-8742-b7501f5494a0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:42.231101 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-36a4f9fd-2948-4edf-8742-b7501f5494a0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:42.233021 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=100 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:42.238869 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-36a4f9fd-2948-4edf-8742-b7501f5494a0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:42.239309 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-36a4f9fd-2948-4edf-8742-b7501f5494a0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:42.240070 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-36a4f9fd-2948-4edf-8742-b7501f5494a0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:42.240497 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-36a4f9fd-2948-4edf-8742-b7501f5494a0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:42.384740 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-36a4f9fd-2948-4edf-8742-b7501f5494a0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:42.392595 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-36a4f9fd-2948-4edf-8742-b7501f5494a0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1367 microversion: 2.1 time: 0.167481 Jul 20 08:31:42.393171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 353/726] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:42 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:42.401585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-6f43abef-ca13-41b9-8812-6fa716864597 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:42.402188 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-6f43abef-ca13-41b9-8812-6fa716864597 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:42.408630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6f43abef-ca13-41b9-8812-6fa716864597 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:42.409081 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6f43abef-ca13-41b9-8812-6fa716864597 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:42.409854 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6f43abef-ca13-41b9-8812-6fa716864597 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:42.410303 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6f43abef-ca13-41b9-8812-6fa716864597 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:42.547529 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-6f43abef-ca13-41b9-8812-6fa716864597 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:42.555448 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-6f43abef-ca13-41b9-8812-6fa716864597 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:42.557073 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-6f43abef-ca13-41b9-8812-6fa716864597 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:42.558222 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-6f43abef-ca13-41b9-8812-6fa716864597 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1723 microversion: 2.20 time: 0.161015 Jul 20 08:31:42.558809 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 354/727] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:42 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:31:42.563258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-26d679db-b997-48b8-9157-b73fe7422c3c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:42.563850 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-26d679db-b997-48b8-9157-b73fe7422c3c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:42.569644 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-26d679db-b997-48b8-9157-b73fe7422c3c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:42.570083 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-26d679db-b997-48b8-9157-b73fe7422c3c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:42.570866 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-26d679db-b997-48b8-9157-b73fe7422c3c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:42.571301 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-26d679db-b997-48b8-9157-b73fe7422c3c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:42.715369 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-26d679db-b997-48b8-9157-b73fe7422c3c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:42.723626 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-26d679db-b997-48b8-9157-b73fe7422c3c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.163722 Jul 20 08:31:42.724412 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 355/728] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:42 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:43.193939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-aa512dc6-978f-425f-bea6-af422f2781ea req-32450f0c-04c5-4395-820d-4069526d0b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e518b913-0606-4cd9-96f7-dfcf59ff8758", "name": "network-vif-plugged", "status": "completed", "tag": "74d72a98-84ae-4d18-bd71-3bf590c0a455"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:43.205053 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-aa512dc6-978f-425f-bea6-af422f2781ea req-32450f0c-04c5-4395-820d-4069526d0b43 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:43.205501 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-aa512dc6-978f-425f-bea6-af422f2781ea req-32450f0c-04c5-4395-820d-4069526d0b43 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:43.217324 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-aa512dc6-978f-425f-bea6-af422f2781ea req-32450f0c-04c5-4395-820d-4069526d0b43 service nova] Creating event network-vif-plugged:74d72a98-84ae-4d18-bd71-3bf590c0a455 for instance e518b913-0606-4cd9-96f7-dfcf59ff8758 on hv-cinder-82308 Jul 20 08:31:43.223194 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-aa512dc6-978f-425f-bea6-af422f2781ea req-32450f0c-04c5-4395-820d-4069526d0b43 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032860 Jul 20 08:31:43.223990 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 356/729] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:31:43.410257 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ae1d8b6e-63a5-4eda-8de8-12827dd24109 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:43.411130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ae1d8b6e-63a5-4eda-8de8-12827dd24109 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:43.417372 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ae1d8b6e-63a5-4eda-8de8-12827dd24109 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:43.417821 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ae1d8b6e-63a5-4eda-8de8-12827dd24109 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:43.418659 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ae1d8b6e-63a5-4eda-8de8-12827dd24109 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:43.419089 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ae1d8b6e-63a5-4eda-8de8-12827dd24109 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:43.589103 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ae1d8b6e-63a5-4eda-8de8-12827dd24109 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:43.596753 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ae1d8b6e-63a5-4eda-8de8-12827dd24109 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1557 microversion: 2.1 time: 0.190721 Jul 20 08:31:43.597332 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 357/730] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:43 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1557 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:31:43.601860 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5bc6cb26-55f9-4095-aa0f-970df07bc176 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:43.602454 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-5bc6cb26-55f9-4095-aa0f-970df07bc176 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:43.610433 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5bc6cb26-55f9-4095-aa0f-970df07bc176 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:43.610905 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5bc6cb26-55f9-4095-aa0f-970df07bc176 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:43.611891 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5bc6cb26-55f9-4095-aa0f-970df07bc176 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:43.612332 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5bc6cb26-55f9-4095-aa0f-970df07bc176 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:43.754744 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5bc6cb26-55f9-4095-aa0f-970df07bc176 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:43.763194 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5bc6cb26-55f9-4095-aa0f-970df07bc176 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:43.764717 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5bc6cb26-55f9-4095-aa0f-970df07bc176 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:43.765877 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-5bc6cb26-55f9-4095-aa0f-970df07bc176 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1726 microversion: 2.20 time: 0.167633 Jul 20 08:31:43.766435 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 358/731] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:43 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:43.770972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-2f4e3ab5-aee8-4192-a3dd-83bd026f5e64 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:43.771447 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-2f4e3ab5-aee8-4192-a3dd-83bd026f5e64 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:43.777953 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2f4e3ab5-aee8-4192-a3dd-83bd026f5e64 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:43.778408 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2f4e3ab5-aee8-4192-a3dd-83bd026f5e64 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:43.779264 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2f4e3ab5-aee8-4192-a3dd-83bd026f5e64 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:43.779699 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2f4e3ab5-aee8-4192-a3dd-83bd026f5e64 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:43.863008 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-2f4e3ab5-aee8-4192-a3dd-83bd026f5e64 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095231 Jul 20 08:31:43.863652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 359/732] 10.222.0.64 () {58 vars in 1274 bytes} [Wed Jul 20 08:31:43 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:31:43.868377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1e8bdb9f-dffa-46ff-a2a8-0233f592b8d1 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:43.869630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1e8bdb9f-dffa-46ff-a2a8-0233f592b8d1 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:43.876247 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1e8bdb9f-dffa-46ff-a2a8-0233f592b8d1 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:43.876703 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1e8bdb9f-dffa-46ff-a2a8-0233f592b8d1 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:43.877477 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1e8bdb9f-dffa-46ff-a2a8-0233f592b8d1 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:43.877918 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1e8bdb9f-dffa-46ff-a2a8-0233f592b8d1 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:44.028503 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1e8bdb9f-dffa-46ff-a2a8-0233f592b8d1 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:44.038662 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1e8bdb9f-dffa-46ff-a2a8-0233f592b8d1 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.173930 Jul 20 08:31:44.039361 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 360/733] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:43 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:44.044991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-4a6e34b0-8164-4127-8224-025fb859b61b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86794f20-b5ad-42f6-ac37-0ace454836e6"}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:44.047304 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-4a6e34b0-8164-4127-8224-025fb859b61b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:44.053796 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4a6e34b0-8164-4127-8224-025fb859b61b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:44.054247 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4a6e34b0-8164-4127-8224-025fb859b61b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:44.055061 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4a6e34b0-8164-4127-8224-025fb859b61b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:44.055497 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4a6e34b0-8164-4127-8224-025fb859b61b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:44.432210 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-4a6e34b0-8164-4127-8224-025fb859b61b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "POST /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.391249 Jul 20 08:31:44.433751 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 361/734] 10.222.0.64 () {62 vars in 1363 bytes} [Wed Jul 20 08:31:44 2022] POST /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments => generated 188 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:31:44.447704 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-483eaeef-bd41-44c0-8c6b-6377f620b601 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "POST /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.770318 Jul 20 08:31:44.448772 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 374/735] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Jul 20 08:31:41 2022] POST /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/os-volume_attachments => generated 194 bytes in 2773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:31:44.597255 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d571bc4c-d0e2-4460-a425-5bdadbbe89c8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:44.597850 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d571bc4c-d0e2-4460-a425-5bdadbbe89c8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:44.604631 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d571bc4c-d0e2-4460-a425-5bdadbbe89c8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:44.605106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d571bc4c-d0e2-4460-a425-5bdadbbe89c8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:44.605873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d571bc4c-d0e2-4460-a425-5bdadbbe89c8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:44.606355 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d571bc4c-d0e2-4460-a425-5bdadbbe89c8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:44.771425 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d571bc4c-d0e2-4460-a425-5bdadbbe89c8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "POST /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/action" status: 202 len: 0 microversion: 2.20 time: 0.178169 Jul 20 08:31:44.775710 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 362/736] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Jul 20 08:31:44 2022] POST /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:31:44.787619 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-cba6efa7-bde9-4352-8a1e-1328c27e5d5e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:44.789346 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-cba6efa7-bde9-4352-8a1e-1328c27e5d5e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:44.797328 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cba6efa7-bde9-4352-8a1e-1328c27e5d5e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:44.797867 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cba6efa7-bde9-4352-8a1e-1328c27e5d5e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:44.799373 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cba6efa7-bde9-4352-8a1e-1328c27e5d5e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:44.800196 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cba6efa7-bde9-4352-8a1e-1328c27e5d5e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:45.065854 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-443f3820-4fdf-4d03-a604-029d2d37e5fb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:45.066807 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-443f3820-4fdf-4d03-a604-029d2d37e5fb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:45.086532 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-443f3820-4fdf-4d03-a604-029d2d37e5fb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:45.087048 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-443f3820-4fdf-4d03-a604-029d2d37e5fb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:45.087855 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-443f3820-4fdf-4d03-a604-029d2d37e5fb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:45.088253 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-443f3820-4fdf-4d03-a604-029d2d37e5fb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:45.285185 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-443f3820-4fdf-4d03-a604-029d2d37e5fb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:45.294311 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-443f3820-4fdf-4d03-a604-029d2d37e5fb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.241630 Jul 20 08:31:45.304980 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 363/737] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:45 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:45.305298 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-cba6efa7-bde9-4352-8a1e-1328c27e5d5e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:45.315462 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-cba6efa7-bde9-4352-8a1e-1328c27e5d5e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:45.317256 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-cba6efa7-bde9-4352-8a1e-1328c27e5d5e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:45.318666 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-cba6efa7-bde9-4352-8a1e-1328c27e5d5e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1812 microversion: 2.20 time: 0.539452 Jul 20 08:31:45.319515 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 375/738] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:44 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1812 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:45.711639 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-c7d3590b-56d5-444a-8970-e3ccb71bcc1d req-8c1aa6fc-f707-49c1-a234-1d47b68f8cde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28eb9e1d-9ca5-43a1-8330-ae91249f609c", "tag": "70393be6-628d-4634-90f4-13212f783bcf"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:45.722235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-c7d3590b-56d5-444a-8970-e3ccb71bcc1d req-8c1aa6fc-f707-49c1-a234-1d47b68f8cde service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:45.722943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-c7d3590b-56d5-444a-8970-e3ccb71bcc1d req-8c1aa6fc-f707-49c1-a234-1d47b68f8cde service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:45.727352 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:45.736319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-c7d3590b-56d5-444a-8970-e3ccb71bcc1d req-8c1aa6fc-f707-49c1-a234-1d47b68f8cde service nova] Creating event network-changed:70393be6-628d-4634-90f4-13212f783bcf for instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c on hv-cinder-82308 Jul 20 08:31:45.741679 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-c7d3590b-56d5-444a-8970-e3ccb71bcc1d req-8c1aa6fc-f707-49c1-a234-1d47b68f8cde service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033713 Jul 20 08:31:45.742282 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 364/739] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:31:46.311479 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4a2af873-1921-4161-9bd4-d20e62861f29 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:46.312095 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4a2af873-1921-4161-9bd4-d20e62861f29 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:46.322412 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4a2af873-1921-4161-9bd4-d20e62861f29 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:46.322889 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4a2af873-1921-4161-9bd4-d20e62861f29 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:46.323683 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4a2af873-1921-4161-9bd4-d20e62861f29 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:46.324116 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4a2af873-1921-4161-9bd4-d20e62861f29 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:46.339632 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f96d1f04-b1ac-4e07-928f-0fa7495eb730 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:46.340387 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f96d1f04-b1ac-4e07-928f-0fa7495eb730 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:46.348876 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f96d1f04-b1ac-4e07-928f-0fa7495eb730 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:46.349414 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f96d1f04-b1ac-4e07-928f-0fa7495eb730 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:46.350238 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f96d1f04-b1ac-4e07-928f-0fa7495eb730 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:46.350715 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f96d1f04-b1ac-4e07-928f-0fa7495eb730 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:46.489562 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4a2af873-1921-4161-9bd4-d20e62861f29 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:46.499684 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4a2af873-1921-4161-9bd4-d20e62861f29 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.192111 Jul 20 08:31:46.500277 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 376/740] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:46 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:46.526043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f96d1f04-b1ac-4e07-928f-0fa7495eb730 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:46.534777 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f96d1f04-b1ac-4e07-928f-0fa7495eb730 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:46.536272 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f96d1f04-b1ac-4e07-928f-0fa7495eb730 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:46.537636 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f96d1f04-b1ac-4e07-928f-0fa7495eb730 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1752 microversion: 2.20 time: 0.203774 Jul 20 08:31:46.538196 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 365/741] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:46 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1752 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:31:47.517995 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c8edb438-3b13-463e-8b63-6530c22a70c5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:47.518650 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c8edb438-3b13-463e-8b63-6530c22a70c5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:47.525738 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c8edb438-3b13-463e-8b63-6530c22a70c5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:47.526181 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c8edb438-3b13-463e-8b63-6530c22a70c5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:47.526994 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c8edb438-3b13-463e-8b63-6530c22a70c5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:47.527427 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c8edb438-3b13-463e-8b63-6530c22a70c5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:47.560699 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e0ba5d92-fe91-4b26-89c4-e9f55ea14c0f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:47.561792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-e0ba5d92-fe91-4b26-89c4-e9f55ea14c0f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:47.573754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e0ba5d92-fe91-4b26-89c4-e9f55ea14c0f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:47.574558 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e0ba5d92-fe91-4b26-89c4-e9f55ea14c0f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:47.576031 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e0ba5d92-fe91-4b26-89c4-e9f55ea14c0f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:47.576825 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e0ba5d92-fe91-4b26-89c4-e9f55ea14c0f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:47.704806 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c8edb438-3b13-463e-8b63-6530c22a70c5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:47.713182 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c8edb438-3b13-463e-8b63-6530c22a70c5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1258 microversion: 2.1 time: 0.198995 Jul 20 08:31:47.713761 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 377/742] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:47 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1258 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:47.756077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e0ba5d92-fe91-4b26-89c4-e9f55ea14c0f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:47.765326 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e0ba5d92-fe91-4b26-89c4-e9f55ea14c0f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:47.766845 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e0ba5d92-fe91-4b26-89c4-e9f55ea14c0f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:47.768032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e0ba5d92-fe91-4b26-89c4-e9f55ea14c0f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1754 microversion: 2.20 time: 0.214404 Jul 20 08:31:47.768599 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 366/743] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:47 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1754 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:31:48.730462 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3d749520-53d7-45bf-babf-58a76acdccf4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:48.731712 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3d749520-53d7-45bf-babf-58a76acdccf4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:48.738705 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3d749520-53d7-45bf-babf-58a76acdccf4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:48.739059 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3d749520-53d7-45bf-babf-58a76acdccf4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:48.739847 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3d749520-53d7-45bf-babf-58a76acdccf4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:48.740278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3d749520-53d7-45bf-babf-58a76acdccf4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:48.797710 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a887c470-6fb4-4844-99b6-1b926ac02ed4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:48.798316 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a887c470-6fb4-4844-99b6-1b926ac02ed4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:48.805077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a887c470-6fb4-4844-99b6-1b926ac02ed4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:48.805533 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a887c470-6fb4-4844-99b6-1b926ac02ed4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:48.806416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a887c470-6fb4-4844-99b6-1b926ac02ed4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:48.807062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a887c470-6fb4-4844-99b6-1b926ac02ed4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:48.957251 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a887c470-6fb4-4844-99b6-1b926ac02ed4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:48.966848 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a887c470-6fb4-4844-99b6-1b926ac02ed4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:48.968380 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a887c470-6fb4-4844-99b6-1b926ac02ed4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:48.969525 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a887c470-6fb4-4844-99b6-1b926ac02ed4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1754 microversion: 2.20 time: 0.177184 Jul 20 08:31:48.970088 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 367/744] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:48 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:49.041280 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3d749520-53d7-45bf-babf-58a76acdccf4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:49.048992 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3d749520-53d7-45bf-babf-58a76acdccf4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1442 microversion: 2.1 time: 0.323088 Jul 20 08:31:49.049674 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 378/745] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:48 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1442 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:49.065962 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a8a62fe2-af8e-46ed-abf9-d3e644dea734 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:49.066908 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a8a62fe2-af8e-46ed-abf9-d3e644dea734 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:49.073979 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a8a62fe2-af8e-46ed-abf9-d3e644dea734 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:49.074434 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a8a62fe2-af8e-46ed-abf9-d3e644dea734 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:49.075335 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a8a62fe2-af8e-46ed-abf9-d3e644dea734 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:49.075796 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a8a62fe2-af8e-46ed-abf9-d3e644dea734 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:49.216194 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a8a62fe2-af8e-46ed-abf9-d3e644dea734 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:49.223783 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a8a62fe2-af8e-46ed-abf9-d3e644dea734 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1442 microversion: 2.1 time: 0.162198 Jul 20 08:31:49.224350 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 368/746] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:49 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1442 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:49.988981 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9030889e-5cc1-49c3-b55b-eaa56c639016 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:49.989593 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9030889e-5cc1-49c3-b55b-eaa56c639016 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:49.999963 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9030889e-5cc1-49c3-b55b-eaa56c639016 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:50.000877 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9030889e-5cc1-49c3-b55b-eaa56c639016 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:50.002363 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9030889e-5cc1-49c3-b55b-eaa56c639016 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:50.003251 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9030889e-5cc1-49c3-b55b-eaa56c639016 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:50.012641 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:31:50.166572 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9030889e-5cc1-49c3-b55b-eaa56c639016 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:50.175451 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9030889e-5cc1-49c3-b55b-eaa56c639016 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:50.176958 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9030889e-5cc1-49c3-b55b-eaa56c639016 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:50.178137 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9030889e-5cc1-49c3-b55b-eaa56c639016 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1754 microversion: 2.20 time: 0.193563 Jul 20 08:31:50.178930 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 379/747] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:49 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1754 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:51.198173 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c25a2fb3-d457-4bed-a190-59c5dcc0f17c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:51.199126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c25a2fb3-d457-4bed-a190-59c5dcc0f17c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:51.206902 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c25a2fb3-d457-4bed-a190-59c5dcc0f17c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:51.207341 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c25a2fb3-d457-4bed-a190-59c5dcc0f17c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:51.208314 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c25a2fb3-d457-4bed-a190-59c5dcc0f17c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:51.208825 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c25a2fb3-d457-4bed-a190-59c5dcc0f17c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:51.241184 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-ca1f0fac-87a6-4d4a-895a-3b8ead617dc1 req-7fcc4255-0188-45e4-a007-86682466e600 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e518b913-0606-4cd9-96f7-dfcf59ff8758", "tag": "74d72a98-84ae-4d18-bd71-3bf590c0a455"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:51.251596 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-ca1f0fac-87a6-4d4a-895a-3b8ead617dc1 req-7fcc4255-0188-45e4-a007-86682466e600 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:51.252044 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-ca1f0fac-87a6-4d4a-895a-3b8ead617dc1 req-7fcc4255-0188-45e4-a007-86682466e600 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:51.265789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-ca1f0fac-87a6-4d4a-895a-3b8ead617dc1 req-7fcc4255-0188-45e4-a007-86682466e600 service nova] Creating event network-changed:74d72a98-84ae-4d18-bd71-3bf590c0a455 for instance e518b913-0606-4cd9-96f7-dfcf59ff8758 on hv-cinder-82308 Jul 20 08:31:51.271065 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-ca1f0fac-87a6-4d4a-895a-3b8ead617dc1 req-7fcc4255-0188-45e4-a007-86682466e600 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033866 Jul 20 08:31:51.271967 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 380/748] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:31:51.359460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c25a2fb3-d457-4bed-a190-59c5dcc0f17c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:51.371317 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c25a2fb3-d457-4bed-a190-59c5dcc0f17c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:51.373226 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c25a2fb3-d457-4bed-a190-59c5dcc0f17c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:51.374400 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c25a2fb3-d457-4bed-a190-59c5dcc0f17c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1754 microversion: 2.20 time: 0.180905 Jul 20 08:31:51.377782 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 369/749] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:51 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1754 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:52.397763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-dd98ea5d-70ae-4eb9-a7b8-6a513da31d17 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:52.398483 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-dd98ea5d-70ae-4eb9-a7b8-6a513da31d17 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:52.405091 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-dd98ea5d-70ae-4eb9-a7b8-6a513da31d17 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:52.405541 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-dd98ea5d-70ae-4eb9-a7b8-6a513da31d17 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:52.406319 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-dd98ea5d-70ae-4eb9-a7b8-6a513da31d17 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:52.406788 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-dd98ea5d-70ae-4eb9-a7b8-6a513da31d17 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:52.537186 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-dd98ea5d-70ae-4eb9-a7b8-6a513da31d17 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:52.546109 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-dd98ea5d-70ae-4eb9-a7b8-6a513da31d17 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:52.547617 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-dd98ea5d-70ae-4eb9-a7b8-6a513da31d17 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:52.548761 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-dd98ea5d-70ae-4eb9-a7b8-6a513da31d17 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1754 microversion: 2.20 time: 0.156031 Jul 20 08:31:52.549533 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 381/750] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:52 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:53.567809 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d83e3496-8d9d-4d2e-87c2-08cbc524da1b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:53.568405 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d83e3496-8d9d-4d2e-87c2-08cbc524da1b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:53.575666 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d83e3496-8d9d-4d2e-87c2-08cbc524da1b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:53.576229 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d83e3496-8d9d-4d2e-87c2-08cbc524da1b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:53.577081 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d83e3496-8d9d-4d2e-87c2-08cbc524da1b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:53.577511 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d83e3496-8d9d-4d2e-87c2-08cbc524da1b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:53.720604 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d83e3496-8d9d-4d2e-87c2-08cbc524da1b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:53.729162 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d83e3496-8d9d-4d2e-87c2-08cbc524da1b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:53.730698 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d83e3496-8d9d-4d2e-87c2-08cbc524da1b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:53.731940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d83e3496-8d9d-4d2e-87c2-08cbc524da1b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1754 microversion: 2.20 time: 0.168035 Jul 20 08:31:53.732500 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 370/751] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:53 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:54.143197 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-88dd7f0e-9808-4029-b4fd-aeee78d20743 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:31:54.144145 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-88dd7f0e-9808-4029-b4fd-aeee78d20743 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:54.151379 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-88dd7f0e-9808-4029-b4fd-aeee78d20743 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:54.151832 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-88dd7f0e-9808-4029-b4fd-aeee78d20743 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:54.152602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-88dd7f0e-9808-4029-b4fd-aeee78d20743 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:54.153057 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-88dd7f0e-9808-4029-b4fd-aeee78d20743 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:54.175660 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.objects.instance [None req-88dd7f0e-9808-4029-b4fd-aeee78d20743 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lazy-loading 'flavor' on Instance uuid bd05a594-404a-4d6e-ab1a-ee3aacb3970d {{(pid=117829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:31:54.331741 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-88dd7f0e-9808-4029-b4fd-aeee78d20743 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "POST /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/action" status: 200 len: 32 microversion: 2.1 time: 0.192549 Jul 20 08:31:54.332361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 382/752] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Jul 20 08:31:54 2022] POST /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/action => generated 32 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 08:31:54.342498 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f9277d9f-5dc2-424a-a985-98be414ad25a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:54.343334 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f9277d9f-5dc2-424a-a985-98be414ad25a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:54.349619 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f9277d9f-5dc2-424a-a985-98be414ad25a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:54.350183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f9277d9f-5dc2-424a-a985-98be414ad25a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:54.350890 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f9277d9f-5dc2-424a-a985-98be414ad25a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:54.351322 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f9277d9f-5dc2-424a-a985-98be414ad25a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:54.486504 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f9277d9f-5dc2-424a-a985-98be414ad25a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:54.495563 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f9277d9f-5dc2-424a-a985-98be414ad25a tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.156976 Jul 20 08:31:54.496150 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 371/753] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:54 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:54.750889 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d96bff95-1477-470a-9d42-44f6dcbf61ff tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:54.751864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d96bff95-1477-470a-9d42-44f6dcbf61ff tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:54.758460 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d96bff95-1477-470a-9d42-44f6dcbf61ff tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:54.759015 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d96bff95-1477-470a-9d42-44f6dcbf61ff tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:54.760616 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d96bff95-1477-470a-9d42-44f6dcbf61ff tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:54.761051 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d96bff95-1477-470a-9d42-44f6dcbf61ff tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:54.963598 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d96bff95-1477-470a-9d42-44f6dcbf61ff tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:54.972076 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d96bff95-1477-470a-9d42-44f6dcbf61ff tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:54.973576 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d96bff95-1477-470a-9d42-44f6dcbf61ff tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:54.974753 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d96bff95-1477-470a-9d42-44f6dcbf61ff tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1754 microversion: 2.20 time: 0.228344 Jul 20 08:31:54.975321 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 383/754] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:54 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1754 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:31:55.513703 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-32af360c-e696-466d-be6b-80658483cdac tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:55.514251 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-32af360c-e696-466d-be6b-80658483cdac tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:55.521699 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-32af360c-e696-466d-be6b-80658483cdac tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:55.522148 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-32af360c-e696-466d-be6b-80658483cdac tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:55.522940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-32af360c-e696-466d-be6b-80658483cdac tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:55.523579 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-32af360c-e696-466d-be6b-80658483cdac tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:55.663601 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-32af360c-e696-466d-be6b-80658483cdac tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:55.672383 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-32af360c-e696-466d-be6b-80658483cdac tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.163499 Jul 20 08:31:55.672956 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 372/755] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:55 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:55.997441 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-76e83f9b-396d-4492-8134-5aa0ad73d4dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:55.999968 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-76e83f9b-396d-4492-8134-5aa0ad73d4dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:56.014781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-76e83f9b-396d-4492-8134-5aa0ad73d4dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:56.015420 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-76e83f9b-396d-4492-8134-5aa0ad73d4dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:56.016202 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-76e83f9b-396d-4492-8134-5aa0ad73d4dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:56.016706 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-76e83f9b-396d-4492-8134-5aa0ad73d4dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:56.223138 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-76e83f9b-396d-4492-8134-5aa0ad73d4dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:56.231841 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-76e83f9b-396d-4492-8134-5aa0ad73d4dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:56.233345 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-76e83f9b-396d-4492-8134-5aa0ad73d4dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:56.234509 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-76e83f9b-396d-4492-8134-5aa0ad73d4dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.244992 Jul 20 08:31:56.235094 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 384/756] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:55 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:56.690194 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-52f7a3f4-2266-4427-9665-00e4e666ba78 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:56.691009 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-52f7a3f4-2266-4427-9665-00e4e666ba78 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:56.707503 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-52f7a3f4-2266-4427-9665-00e4e666ba78 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:56.708984 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-52f7a3f4-2266-4427-9665-00e4e666ba78 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:56.710345 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-52f7a3f4-2266-4427-9665-00e4e666ba78 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:56.713961 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-52f7a3f4-2266-4427-9665-00e4e666ba78 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:56.870959 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-52f7a3f4-2266-4427-9665-00e4e666ba78 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:56.888137 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-52f7a3f4-2266-4427-9665-00e4e666ba78 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.201616 Jul 20 08:31:56.888955 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 373/757] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:56 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:57.253413 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-00cb9e22-76a5-42ef-b75a-4c54dbdf0d12 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:57.254161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-00cb9e22-76a5-42ef-b75a-4c54dbdf0d12 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:57.262150 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-00cb9e22-76a5-42ef-b75a-4c54dbdf0d12 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:57.262609 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-00cb9e22-76a5-42ef-b75a-4c54dbdf0d12 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:57.263387 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-00cb9e22-76a5-42ef-b75a-4c54dbdf0d12 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:57.263819 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-00cb9e22-76a5-42ef-b75a-4c54dbdf0d12 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:57.398105 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-00cb9e22-76a5-42ef-b75a-4c54dbdf0d12 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:57.407479 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-00cb9e22-76a5-42ef-b75a-4c54dbdf0d12 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:57.409035 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-00cb9e22-76a5-42ef-b75a-4c54dbdf0d12 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:57.410984 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-00cb9e22-76a5-42ef-b75a-4c54dbdf0d12 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.161437 Jul 20 08:31:57.411688 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 385/758] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:57 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:57.908351 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-02b52cff-1c4b-47b1-aca0-110aff660eef tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:57.908954 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-02b52cff-1c4b-47b1-aca0-110aff660eef tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:57.916180 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-02b52cff-1c4b-47b1-aca0-110aff660eef tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:57.916620 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-02b52cff-1c4b-47b1-aca0-110aff660eef tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:57.917391 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-02b52cff-1c4b-47b1-aca0-110aff660eef tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:57.917827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-02b52cff-1c4b-47b1-aca0-110aff660eef tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:58.053988 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-02b52cff-1c4b-47b1-aca0-110aff660eef tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:58.062500 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-02b52cff-1c4b-47b1-aca0-110aff660eef tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.157808 Jul 20 08:31:58.063110 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 374/759] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:57 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:58.430622 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6d6745db-25ba-4735-a7fd-def6da28b466 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:58.431782 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6d6745db-25ba-4735-a7fd-def6da28b466 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:58.438426 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6d6745db-25ba-4735-a7fd-def6da28b466 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:58.438920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6d6745db-25ba-4735-a7fd-def6da28b466 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:58.439694 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6d6745db-25ba-4735-a7fd-def6da28b466 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:58.440129 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6d6745db-25ba-4735-a7fd-def6da28b466 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:58.596887 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6d6745db-25ba-4735-a7fd-def6da28b466 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:58.606226 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6d6745db-25ba-4735-a7fd-def6da28b466 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:58.607758 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6d6745db-25ba-4735-a7fd-def6da28b466 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:58.608949 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6d6745db-25ba-4735-a7fd-def6da28b466 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.182290 Jul 20 08:31:58.609720 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 386/760] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:58 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:31:59.080661 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c90530ae-ee8d-41a9-98c3-ce39e18dad14 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:59.081385 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c90530ae-ee8d-41a9-98c3-ce39e18dad14 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:59.088171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c90530ae-ee8d-41a9-98c3-ce39e18dad14 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:59.088623 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c90530ae-ee8d-41a9-98c3-ce39e18dad14 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:59.089406 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c90530ae-ee8d-41a9-98c3-ce39e18dad14 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:59.089406 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c90530ae-ee8d-41a9-98c3-ce39e18dad14 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:59.250036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c90530ae-ee8d-41a9-98c3-ce39e18dad14 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:59.258094 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c90530ae-ee8d-41a9-98c3-ce39e18dad14 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.181258 Jul 20 08:31:59.258677 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 375/761] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:31:59 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:31:59.628854 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-0806d96c-3977-486d-86ba-be4d5261c9d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:31:59.629483 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-0806d96c-3977-486d-86ba-be4d5261c9d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:31:59.636480 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0806d96c-3977-486d-86ba-be4d5261c9d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:59.636921 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0806d96c-3977-486d-86ba-be4d5261c9d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:59.637943 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0806d96c-3977-486d-86ba-be4d5261c9d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:31:59.638377 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0806d96c-3977-486d-86ba-be4d5261c9d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:31:59.784010 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0806d96c-3977-486d-86ba-be4d5261c9d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:59.792933 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0806d96c-3977-486d-86ba-be4d5261c9d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:59.794411 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0806d96c-3977-486d-86ba-be4d5261c9d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:31:59.795589 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-0806d96c-3977-486d-86ba-be4d5261c9d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.171133 Jul 20 08:31:59.796143 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 387/762] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:31:59 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:00.277137 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-2aa4bfff-25a0-4a5f-aa96-52b22d514f9d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:00.277717 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-2aa4bfff-25a0-4a5f-aa96-52b22d514f9d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:00.284441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2aa4bfff-25a0-4a5f-aa96-52b22d514f9d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:00.284902 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2aa4bfff-25a0-4a5f-aa96-52b22d514f9d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:00.285655 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2aa4bfff-25a0-4a5f-aa96-52b22d514f9d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:00.286538 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2aa4bfff-25a0-4a5f-aa96-52b22d514f9d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:00.423879 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2aa4bfff-25a0-4a5f-aa96-52b22d514f9d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:00.432161 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-2aa4bfff-25a0-4a5f-aa96-52b22d514f9d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.159165 Jul 20 08:32:00.432727 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 376/763] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:00 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:00.813689 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-766c7dd9-7338-4119-bc9d-eebee21ca1d3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:00.814287 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-766c7dd9-7338-4119-bc9d-eebee21ca1d3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:00.820955 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-766c7dd9-7338-4119-bc9d-eebee21ca1d3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:00.822228 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-766c7dd9-7338-4119-bc9d-eebee21ca1d3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:00.823042 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-766c7dd9-7338-4119-bc9d-eebee21ca1d3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:00.823473 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-766c7dd9-7338-4119-bc9d-eebee21ca1d3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:00.958468 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-766c7dd9-7338-4119-bc9d-eebee21ca1d3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:00.967932 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-766c7dd9-7338-4119-bc9d-eebee21ca1d3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:00.969416 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-766c7dd9-7338-4119-bc9d-eebee21ca1d3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:00.970566 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-766c7dd9-7338-4119-bc9d-eebee21ca1d3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.160967 Jul 20 08:32:00.971147 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 388/764] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:00 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:01.449986 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a7ba50be-8aad-4cde-b744-8d315c1461d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:01.450564 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a7ba50be-8aad-4cde-b744-8d315c1461d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:01.457930 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a7ba50be-8aad-4cde-b744-8d315c1461d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:01.458394 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a7ba50be-8aad-4cde-b744-8d315c1461d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:01.459207 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a7ba50be-8aad-4cde-b744-8d315c1461d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:01.459647 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a7ba50be-8aad-4cde-b744-8d315c1461d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:01.593768 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a7ba50be-8aad-4cde-b744-8d315c1461d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:01.601899 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a7ba50be-8aad-4cde-b744-8d315c1461d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.156567 Jul 20 08:32:01.603573 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 377/765] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:01 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:01.989337 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d4612169-49a8-4d00-a65f-933d3d243d84 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:01.990047 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d4612169-49a8-4d00-a65f-933d3d243d84 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:01.997324 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d4612169-49a8-4d00-a65f-933d3d243d84 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:01.997850 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d4612169-49a8-4d00-a65f-933d3d243d84 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:01.998741 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d4612169-49a8-4d00-a65f-933d3d243d84 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:01.999239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d4612169-49a8-4d00-a65f-933d3d243d84 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:02.139609 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d4612169-49a8-4d00-a65f-933d3d243d84 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:02.148174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d4612169-49a8-4d00-a65f-933d3d243d84 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:02.150334 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d4612169-49a8-4d00-a65f-933d3d243d84 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:02.151548 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d4612169-49a8-4d00-a65f-933d3d243d84 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.166172 Jul 20 08:32:02.152305 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 389/766] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:01 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:02.620699 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-977eebb8-1fa2-4208-8447-b4d362916641 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:02.621303 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-977eebb8-1fa2-4208-8447-b4d362916641 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:02.628218 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-977eebb8-1fa2-4208-8447-b4d362916641 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:02.628675 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-977eebb8-1fa2-4208-8447-b4d362916641 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:02.629458 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-977eebb8-1fa2-4208-8447-b4d362916641 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:02.629895 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-977eebb8-1fa2-4208-8447-b4d362916641 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:02.769330 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-977eebb8-1fa2-4208-8447-b4d362916641 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:02.778396 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-977eebb8-1fa2-4208-8447-b4d362916641 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.162115 Jul 20 08:32:02.779029 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 378/767] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:02 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:03.169961 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f85982ad-6e73-4173-8c01-a6fa32c777e2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:03.170624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f85982ad-6e73-4173-8c01-a6fa32c777e2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:03.177322 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f85982ad-6e73-4173-8c01-a6fa32c777e2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:03.177766 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f85982ad-6e73-4173-8c01-a6fa32c777e2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:03.178542 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f85982ad-6e73-4173-8c01-a6fa32c777e2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:03.178995 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f85982ad-6e73-4173-8c01-a6fa32c777e2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:03.318610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f85982ad-6e73-4173-8c01-a6fa32c777e2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:03.329011 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f85982ad-6e73-4173-8c01-a6fa32c777e2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:03.330439 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f85982ad-6e73-4173-8c01-a6fa32c777e2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:03.331653 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f85982ad-6e73-4173-8c01-a6fa32c777e2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.165609 Jul 20 08:32:03.332220 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 390/768] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:03 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:03.796855 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-bb35e488-45ec-4667-93f5-b0544882b3bf tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:03.798961 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-bb35e488-45ec-4667-93f5-b0544882b3bf tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:03.806896 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bb35e488-45ec-4667-93f5-b0544882b3bf tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:03.808063 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bb35e488-45ec-4667-93f5-b0544882b3bf tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:03.809878 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bb35e488-45ec-4667-93f5-b0544882b3bf tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:03.810652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bb35e488-45ec-4667-93f5-b0544882b3bf tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:03.959742 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-bb35e488-45ec-4667-93f5-b0544882b3bf tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:03.968266 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-bb35e488-45ec-4667-93f5-b0544882b3bf tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.176071 Jul 20 08:32:03.968939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 379/769] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:03 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:04.351085 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9aede9d6-9b10-47ce-96fb-4fae33725f85 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:04.351730 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9aede9d6-9b10-47ce-96fb-4fae33725f85 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:04.354409 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=68 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:32:04.359936 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9aede9d6-9b10-47ce-96fb-4fae33725f85 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:04.360381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9aede9d6-9b10-47ce-96fb-4fae33725f85 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:04.361159 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9aede9d6-9b10-47ce-96fb-4fae33725f85 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:04.361593 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9aede9d6-9b10-47ce-96fb-4fae33725f85 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:04.502979 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9aede9d6-9b10-47ce-96fb-4fae33725f85 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:04.513589 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9aede9d6-9b10-47ce-96fb-4fae33725f85 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:04.515102 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9aede9d6-9b10-47ce-96fb-4fae33725f85 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:04.516266 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9aede9d6-9b10-47ce-96fb-4fae33725f85 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.169155 Jul 20 08:32:04.529680 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 391/770] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:04 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:04.986039 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0a91ac52-edc5-4a8b-97ef-520dedf23628 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:04.986723 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0a91ac52-edc5-4a8b-97ef-520dedf23628 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:04.993431 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0a91ac52-edc5-4a8b-97ef-520dedf23628 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:04.993880 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0a91ac52-edc5-4a8b-97ef-520dedf23628 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:04.995339 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0a91ac52-edc5-4a8b-97ef-520dedf23628 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:04.995780 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0a91ac52-edc5-4a8b-97ef-520dedf23628 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:05.147280 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-0a91ac52-edc5-4a8b-97ef-520dedf23628 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:05.156054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0a91ac52-edc5-4a8b-97ef-520dedf23628 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.173901 Jul 20 08:32:05.156836 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 380/771] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:04 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:05.536489 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-454559a2-b026-44ab-aceb-47088d97e807 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:05.537115 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-454559a2-b026-44ab-aceb-47088d97e807 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:05.544386 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-454559a2-b026-44ab-aceb-47088d97e807 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:05.544833 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-454559a2-b026-44ab-aceb-47088d97e807 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:05.545593 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-454559a2-b026-44ab-aceb-47088d97e807 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:05.546024 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-454559a2-b026-44ab-aceb-47088d97e807 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:05.680446 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-454559a2-b026-44ab-aceb-47088d97e807 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:05.689058 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-454559a2-b026-44ab-aceb-47088d97e807 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:05.690563 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-454559a2-b026-44ab-aceb-47088d97e807 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:05.691736 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-454559a2-b026-44ab-aceb-47088d97e807 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.159168 Jul 20 08:32:05.692292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 392/772] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:05 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:06.173646 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c27d92e5-3783-4bfc-8b03-1d3f23d3b984 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:06.174264 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c27d92e5-3783-4bfc-8b03-1d3f23d3b984 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:06.192321 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c27d92e5-3783-4bfc-8b03-1d3f23d3b984 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:06.192901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c27d92e5-3783-4bfc-8b03-1d3f23d3b984 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:06.193860 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c27d92e5-3783-4bfc-8b03-1d3f23d3b984 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:06.194450 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c27d92e5-3783-4bfc-8b03-1d3f23d3b984 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:06.215769 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=100 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:32:06.332353 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c27d92e5-3783-4bfc-8b03-1d3f23d3b984 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:06.341127 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c27d92e5-3783-4bfc-8b03-1d3f23d3b984 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.171350 Jul 20 08:32:06.341695 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 381/773] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:06 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:06.710632 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d5a14a0b-1b54-46b0-831d-6799d546e6e4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:06.711260 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d5a14a0b-1b54-46b0-831d-6799d546e6e4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:06.719514 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d5a14a0b-1b54-46b0-831d-6799d546e6e4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:06.719961 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d5a14a0b-1b54-46b0-831d-6799d546e6e4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:06.720741 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d5a14a0b-1b54-46b0-831d-6799d546e6e4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:06.721175 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d5a14a0b-1b54-46b0-831d-6799d546e6e4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:06.854844 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d5a14a0b-1b54-46b0-831d-6799d546e6e4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:06.863736 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d5a14a0b-1b54-46b0-831d-6799d546e6e4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:06.865244 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d5a14a0b-1b54-46b0-831d-6799d546e6e4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:06.866417 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d5a14a0b-1b54-46b0-831d-6799d546e6e4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.159770 Jul 20 08:32:06.867026 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 393/774] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:06 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:07.358673 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1b4879d4-07a1-456c-8a3d-8142d9dcfc2f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:07.359504 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1b4879d4-07a1-456c-8a3d-8142d9dcfc2f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:07.366395 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1b4879d4-07a1-456c-8a3d-8142d9dcfc2f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:07.366870 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1b4879d4-07a1-456c-8a3d-8142d9dcfc2f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:07.367649 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1b4879d4-07a1-456c-8a3d-8142d9dcfc2f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:07.368077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1b4879d4-07a1-456c-8a3d-8142d9dcfc2f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:07.522665 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1b4879d4-07a1-456c-8a3d-8142d9dcfc2f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:07.531460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1b4879d4-07a1-456c-8a3d-8142d9dcfc2f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.176783 Jul 20 08:32:07.532034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 382/775] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:07 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:07.885173 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-50eed8ba-db92-458d-a82d-8df0161e5975 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:07.886133 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-50eed8ba-db92-458d-a82d-8df0161e5975 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:07.894456 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-50eed8ba-db92-458d-a82d-8df0161e5975 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:07.895008 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-50eed8ba-db92-458d-a82d-8df0161e5975 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:07.895934 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-50eed8ba-db92-458d-a82d-8df0161e5975 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:07.896440 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-50eed8ba-db92-458d-a82d-8df0161e5975 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:07.916758 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:32:08.050068 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-50eed8ba-db92-458d-a82d-8df0161e5975 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:08.058925 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-50eed8ba-db92-458d-a82d-8df0161e5975 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:08.060436 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-50eed8ba-db92-458d-a82d-8df0161e5975 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:08.061646 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-50eed8ba-db92-458d-a82d-8df0161e5975 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.180361 Jul 20 08:32:08.062215 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 394/776] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:07 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:08.548747 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-23eca233-17a2-46bd-96e8-15cde790818e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:08.549496 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-23eca233-17a2-46bd-96e8-15cde790818e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:08.555979 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-23eca233-17a2-46bd-96e8-15cde790818e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:08.556427 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-23eca233-17a2-46bd-96e8-15cde790818e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:08.557211 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-23eca233-17a2-46bd-96e8-15cde790818e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:08.557639 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-23eca233-17a2-46bd-96e8-15cde790818e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:08.711917 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-23eca233-17a2-46bd-96e8-15cde790818e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:08.720604 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-23eca233-17a2-46bd-96e8-15cde790818e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.175906 Jul 20 08:32:08.721518 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 383/777] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:08 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:09.080539 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-48bb803e-38bb-4ba5-a89c-08c74607b941 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:09.081146 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-48bb803e-38bb-4ba5-a89c-08c74607b941 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:09.088058 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-48bb803e-38bb-4ba5-a89c-08c74607b941 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:09.088505 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-48bb803e-38bb-4ba5-a89c-08c74607b941 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:09.089277 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-48bb803e-38bb-4ba5-a89c-08c74607b941 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:09.090243 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-48bb803e-38bb-4ba5-a89c-08c74607b941 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:09.237832 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-48bb803e-38bb-4ba5-a89c-08c74607b941 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:09.247175 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-48bb803e-38bb-4ba5-a89c-08c74607b941 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:09.248349 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-48bb803e-38bb-4ba5-a89c-08c74607b941 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:09.249500 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-48bb803e-38bb-4ba5-a89c-08c74607b941 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.172894 Jul 20 08:32:09.250054 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 395/778] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:09 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:09.741691 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-19b62b6f-095d-4236-b76b-c3828c0529f5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:09.742377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-19b62b6f-095d-4236-b76b-c3828c0529f5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:09.750162 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-19b62b6f-095d-4236-b76b-c3828c0529f5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:09.750831 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-19b62b6f-095d-4236-b76b-c3828c0529f5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:09.751735 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-19b62b6f-095d-4236-b76b-c3828c0529f5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:09.752169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-19b62b6f-095d-4236-b76b-c3828c0529f5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:09.897575 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-19b62b6f-095d-4236-b76b-c3828c0529f5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:09.912613 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-19b62b6f-095d-4236-b76b-c3828c0529f5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.174421 Jul 20 08:32:09.913711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 384/779] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:09 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:10.268778 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c0c2fb30-501c-4adc-bff9-d33763701bdf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:10.269418 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c0c2fb30-501c-4adc-bff9-d33763701bdf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:10.276055 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c0c2fb30-501c-4adc-bff9-d33763701bdf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:10.276444 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c0c2fb30-501c-4adc-bff9-d33763701bdf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:10.277354 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c0c2fb30-501c-4adc-bff9-d33763701bdf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:10.277756 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c0c2fb30-501c-4adc-bff9-d33763701bdf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:10.418018 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c0c2fb30-501c-4adc-bff9-d33763701bdf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:10.426455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c0c2fb30-501c-4adc-bff9-d33763701bdf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:10.428001 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c0c2fb30-501c-4adc-bff9-d33763701bdf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:10.429180 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c0c2fb30-501c-4adc-bff9-d33763701bdf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.164352 Jul 20 08:32:10.429737 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 396/780] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:10 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:10.930918 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9328301c-c416-48e3-9c0f-badd2d58e862 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:10.932905 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9328301c-c416-48e3-9c0f-badd2d58e862 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:10.938859 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9328301c-c416-48e3-9c0f-badd2d58e862 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:10.939314 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9328301c-c416-48e3-9c0f-badd2d58e862 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:10.940078 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9328301c-c416-48e3-9c0f-badd2d58e862 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:10.940513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9328301c-c416-48e3-9c0f-badd2d58e862 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:11.084831 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9328301c-c416-48e3-9c0f-badd2d58e862 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:11.092953 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9328301c-c416-48e3-9c0f-badd2d58e862 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.165979 Jul 20 08:32:11.093537 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 385/781] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:10 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:11.447525 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ab6bbaee-a4be-44fe-89c5-36249a608934 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:11.448121 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ab6bbaee-a4be-44fe-89c5-36249a608934 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:11.455455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ab6bbaee-a4be-44fe-89c5-36249a608934 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:11.455898 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ab6bbaee-a4be-44fe-89c5-36249a608934 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:11.456659 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ab6bbaee-a4be-44fe-89c5-36249a608934 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:11.457086 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ab6bbaee-a4be-44fe-89c5-36249a608934 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:11.593707 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ab6bbaee-a4be-44fe-89c5-36249a608934 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:11.605497 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ab6bbaee-a4be-44fe-89c5-36249a608934 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:11.607785 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ab6bbaee-a4be-44fe-89c5-36249a608934 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:11.609241 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ab6bbaee-a4be-44fe-89c5-36249a608934 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.165602 Jul 20 08:32:11.609803 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 397/782] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:11 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:12.111334 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-af5f1fa5-fbdf-4470-be70-70a97c87636d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:12.111969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-af5f1fa5-fbdf-4470-be70-70a97c87636d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:12.118981 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-af5f1fa5-fbdf-4470-be70-70a97c87636d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:12.119432 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-af5f1fa5-fbdf-4470-be70-70a97c87636d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:12.120207 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-af5f1fa5-fbdf-4470-be70-70a97c87636d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:12.120645 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-af5f1fa5-fbdf-4470-be70-70a97c87636d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:12.265717 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-af5f1fa5-fbdf-4470-be70-70a97c87636d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:12.273996 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-af5f1fa5-fbdf-4470-be70-70a97c87636d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.167038 Jul 20 08:32:12.274661 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 386/783] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:12 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:12.631162 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-68f0655d-8239-4a21-9114-e2a81672901b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:12.631781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-68f0655d-8239-4a21-9114-e2a81672901b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:12.639550 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-68f0655d-8239-4a21-9114-e2a81672901b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:12.639998 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-68f0655d-8239-4a21-9114-e2a81672901b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:12.640773 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-68f0655d-8239-4a21-9114-e2a81672901b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:12.641206 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-68f0655d-8239-4a21-9114-e2a81672901b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:12.774284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-68f0655d-8239-4a21-9114-e2a81672901b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:12.783130 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-68f0655d-8239-4a21-9114-e2a81672901b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:12.784615 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-68f0655d-8239-4a21-9114-e2a81672901b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:12.785762 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-68f0655d-8239-4a21-9114-e2a81672901b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.158536 Jul 20 08:32:12.786319 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 398/784] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:12 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:13.292046 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-89692c7d-bbc1-4f4a-8482-f4e2658cd21d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:13.292598 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-89692c7d-bbc1-4f4a-8482-f4e2658cd21d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:13.294953 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=70 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:32:13.300272 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-89692c7d-bbc1-4f4a-8482-f4e2658cd21d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:13.300722 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-89692c7d-bbc1-4f4a-8482-f4e2658cd21d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:13.301493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-89692c7d-bbc1-4f4a-8482-f4e2658cd21d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:13.301930 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-89692c7d-bbc1-4f4a-8482-f4e2658cd21d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:13.441566 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-89692c7d-bbc1-4f4a-8482-f4e2658cd21d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:13.450613 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-89692c7d-bbc1-4f4a-8482-f4e2658cd21d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.162144 Jul 20 08:32:13.451195 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 387/785] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:13 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:13.804113 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3c30e898-9853-40cf-ba1e-2934f5d0b47b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:13.804711 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3c30e898-9853-40cf-ba1e-2934f5d0b47b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:13.811796 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3c30e898-9853-40cf-ba1e-2934f5d0b47b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:13.812242 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3c30e898-9853-40cf-ba1e-2934f5d0b47b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:13.813011 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3c30e898-9853-40cf-ba1e-2934f5d0b47b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:13.813445 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3c30e898-9853-40cf-ba1e-2934f5d0b47b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:13.957631 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3c30e898-9853-40cf-ba1e-2934f5d0b47b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:13.968801 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3c30e898-9853-40cf-ba1e-2934f5d0b47b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:13.970334 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3c30e898-9853-40cf-ba1e-2934f5d0b47b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:13.971522 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3c30e898-9853-40cf-ba1e-2934f5d0b47b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.171406 Jul 20 08:32:13.972089 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 399/786] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:13 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:14.468351 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e55769a2-31e4-47ab-8131-223ebd56e449 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:14.468954 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-e55769a2-31e4-47ab-8131-223ebd56e449 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:14.475579 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e55769a2-31e4-47ab-8131-223ebd56e449 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:14.476039 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e55769a2-31e4-47ab-8131-223ebd56e449 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:14.476815 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e55769a2-31e4-47ab-8131-223ebd56e449 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:14.477256 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e55769a2-31e4-47ab-8131-223ebd56e449 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:14.614547 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e55769a2-31e4-47ab-8131-223ebd56e449 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:14.622618 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e55769a2-31e4-47ab-8131-223ebd56e449 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.158658 Jul 20 08:32:14.623189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 388/787] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:14 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:14.990848 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-40cee4f9-d91c-4d73-a445-e96196a4a909 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:14.991413 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-40cee4f9-d91c-4d73-a445-e96196a4a909 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:14.998305 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-40cee4f9-d91c-4d73-a445-e96196a4a909 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:14.998804 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-40cee4f9-d91c-4d73-a445-e96196a4a909 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:14.999592 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-40cee4f9-d91c-4d73-a445-e96196a4a909 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:15.000029 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-40cee4f9-d91c-4d73-a445-e96196a4a909 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:15.138214 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-40cee4f9-d91c-4d73-a445-e96196a4a909 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:15.147055 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-40cee4f9-d91c-4d73-a445-e96196a4a909 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:15.148542 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-40cee4f9-d91c-4d73-a445-e96196a4a909 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:15.149705 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-40cee4f9-d91c-4d73-a445-e96196a4a909 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.162942 Jul 20 08:32:15.150276 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 400/788] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:14 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:15.640546 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3894b96f-c3e1-49bc-bc4a-25b21d06366c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:15.641150 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-3894b96f-c3e1-49bc-bc4a-25b21d06366c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:15.647628 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3894b96f-c3e1-49bc-bc4a-25b21d06366c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:15.648117 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3894b96f-c3e1-49bc-bc4a-25b21d06366c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:15.648881 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3894b96f-c3e1-49bc-bc4a-25b21d06366c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:15.649309 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3894b96f-c3e1-49bc-bc4a-25b21d06366c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:15.780916 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3894b96f-c3e1-49bc-bc4a-25b21d06366c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:15.789436 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-3894b96f-c3e1-49bc-bc4a-25b21d06366c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.152720 Jul 20 08:32:15.790029 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 389/789] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:15 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:16.168137 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f16dba60-ce95-4043-865f-b1bb7b67dc17 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:16.168922 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f16dba60-ce95-4043-865f-b1bb7b67dc17 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:16.175523 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f16dba60-ce95-4043-865f-b1bb7b67dc17 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:16.175999 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f16dba60-ce95-4043-865f-b1bb7b67dc17 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:16.176767 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f16dba60-ce95-4043-865f-b1bb7b67dc17 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:16.177198 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f16dba60-ce95-4043-865f-b1bb7b67dc17 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:16.310820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f16dba60-ce95-4043-865f-b1bb7b67dc17 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:16.319162 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f16dba60-ce95-4043-865f-b1bb7b67dc17 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:16.320652 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f16dba60-ce95-4043-865f-b1bb7b67dc17 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:16.321806 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f16dba60-ce95-4043-865f-b1bb7b67dc17 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.157796 Jul 20 08:32:16.322360 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 401/790] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:16 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:16.806750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-31a3b836-0704-43eb-9c77-a4975967edd7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:16.807337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-31a3b836-0704-43eb-9c77-a4975967edd7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:16.814418 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-31a3b836-0704-43eb-9c77-a4975967edd7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:16.814916 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-31a3b836-0704-43eb-9c77-a4975967edd7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:16.815714 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-31a3b836-0704-43eb-9c77-a4975967edd7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:16.816151 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-31a3b836-0704-43eb-9c77-a4975967edd7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:16.949112 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-31a3b836-0704-43eb-9c77-a4975967edd7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:16.957343 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-31a3b836-0704-43eb-9c77-a4975967edd7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.154470 Jul 20 08:32:16.957932 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 390/791] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:16 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:17.341396 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-15510e2e-8caf-4f63-af48-c161a6caa3bb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:17.341949 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-15510e2e-8caf-4f63-af48-c161a6caa3bb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:17.348694 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-15510e2e-8caf-4f63-af48-c161a6caa3bb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:17.349143 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-15510e2e-8caf-4f63-af48-c161a6caa3bb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:17.349911 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-15510e2e-8caf-4f63-af48-c161a6caa3bb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:17.350349 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-15510e2e-8caf-4f63-af48-c161a6caa3bb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:17.482674 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-15510e2e-8caf-4f63-af48-c161a6caa3bb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:17.490927 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-15510e2e-8caf-4f63-af48-c161a6caa3bb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:17.492405 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-15510e2e-8caf-4f63-af48-c161a6caa3bb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:17.493554 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-15510e2e-8caf-4f63-af48-c161a6caa3bb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.156657 Jul 20 08:32:17.494104 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 402/792] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:17 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:17.975074 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-2197123a-6aa3-44d5-8e83-44d6dc5c29bd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:17.975666 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-2197123a-6aa3-44d5-8e83-44d6dc5c29bd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:17.982313 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2197123a-6aa3-44d5-8e83-44d6dc5c29bd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:17.982806 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2197123a-6aa3-44d5-8e83-44d6dc5c29bd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:17.983574 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2197123a-6aa3-44d5-8e83-44d6dc5c29bd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:17.984012 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2197123a-6aa3-44d5-8e83-44d6dc5c29bd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:18.117163 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2197123a-6aa3-44d5-8e83-44d6dc5c29bd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:18.126307 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-2197123a-6aa3-44d5-8e83-44d6dc5c29bd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.155075 Jul 20 08:32:18.126926 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 391/793] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:17 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:18.512411 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f767d852-5c78-450c-b838-278cc6e5f0ce tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:18.513014 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f767d852-5c78-450c-b838-278cc6e5f0ce tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:18.519883 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f767d852-5c78-450c-b838-278cc6e5f0ce tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:18.520337 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f767d852-5c78-450c-b838-278cc6e5f0ce tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:18.521100 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f767d852-5c78-450c-b838-278cc6e5f0ce tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:18.521529 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f767d852-5c78-450c-b838-278cc6e5f0ce tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:18.653900 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f767d852-5c78-450c-b838-278cc6e5f0ce tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:18.662533 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f767d852-5c78-450c-b838-278cc6e5f0ce tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:18.664050 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f767d852-5c78-450c-b838-278cc6e5f0ce tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:18.665193 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f767d852-5c78-450c-b838-278cc6e5f0ce tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.157005 Jul 20 08:32:18.665738 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 403/794] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:18 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:19.143948 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-886d9d5c-92c4-4e6c-809d-7544a959c0bd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:19.144596 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-886d9d5c-92c4-4e6c-809d-7544a959c0bd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:19.150938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-886d9d5c-92c4-4e6c-809d-7544a959c0bd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:19.151382 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-886d9d5c-92c4-4e6c-809d-7544a959c0bd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:19.152773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-886d9d5c-92c4-4e6c-809d-7544a959c0bd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:19.153238 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-886d9d5c-92c4-4e6c-809d-7544a959c0bd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:19.286145 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-886d9d5c-92c4-4e6c-809d-7544a959c0bd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:19.299251 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-886d9d5c-92c4-4e6c-809d-7544a959c0bd tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.159099 Jul 20 08:32:19.299837 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 392/795] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:19 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:19.684106 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-60be8548-6e68-4e16-ba2d-9b1e1c0004f2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:19.684710 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-60be8548-6e68-4e16-ba2d-9b1e1c0004f2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:19.691582 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-60be8548-6e68-4e16-ba2d-9b1e1c0004f2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:19.692035 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-60be8548-6e68-4e16-ba2d-9b1e1c0004f2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:19.692841 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-60be8548-6e68-4e16-ba2d-9b1e1c0004f2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:19.693282 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-60be8548-6e68-4e16-ba2d-9b1e1c0004f2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:19.830830 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-60be8548-6e68-4e16-ba2d-9b1e1c0004f2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:19.841254 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-60be8548-6e68-4e16-ba2d-9b1e1c0004f2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:19.842711 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-60be8548-6e68-4e16-ba2d-9b1e1c0004f2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:19.843878 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-60be8548-6e68-4e16-ba2d-9b1e1c0004f2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.164325 Jul 20 08:32:19.844473 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 404/796] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:19 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:20.316807 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ebfaa248-825b-4d2c-ab77-e6dce2a1fd5f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:20.317410 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ebfaa248-825b-4d2c-ab77-e6dce2a1fd5f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:20.324208 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ebfaa248-825b-4d2c-ab77-e6dce2a1fd5f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:20.324662 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ebfaa248-825b-4d2c-ab77-e6dce2a1fd5f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:20.325448 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ebfaa248-825b-4d2c-ab77-e6dce2a1fd5f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:20.325886 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ebfaa248-825b-4d2c-ab77-e6dce2a1fd5f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:20.457473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ebfaa248-825b-4d2c-ab77-e6dce2a1fd5f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:20.466128 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ebfaa248-825b-4d2c-ab77-e6dce2a1fd5f tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.153156 Jul 20 08:32:20.466733 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 393/797] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:20 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:32:20.861796 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e36c8e27-874d-498f-9557-5528182e697f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:20.862398 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e36c8e27-874d-498f-9557-5528182e697f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:20.868922 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e36c8e27-874d-498f-9557-5528182e697f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:20.869368 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e36c8e27-874d-498f-9557-5528182e697f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:20.870131 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e36c8e27-874d-498f-9557-5528182e697f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:20.870568 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e36c8e27-874d-498f-9557-5528182e697f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:21.001483 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e36c8e27-874d-498f-9557-5528182e697f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:21.010092 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e36c8e27-874d-498f-9557-5528182e697f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:21.012719 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e36c8e27-874d-498f-9557-5528182e697f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:21.013888 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e36c8e27-874d-498f-9557-5528182e697f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.156058 Jul 20 08:32:21.014445 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 405/798] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:20 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:21.486139 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9bd30232-4072-4457-ac07-eb55ce76d281 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:21.486756 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9bd30232-4072-4457-ac07-eb55ce76d281 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:21.493673 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9bd30232-4072-4457-ac07-eb55ce76d281 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:21.494119 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9bd30232-4072-4457-ac07-eb55ce76d281 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:21.494962 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9bd30232-4072-4457-ac07-eb55ce76d281 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:21.495417 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9bd30232-4072-4457-ac07-eb55ce76d281 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:21.640212 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9bd30232-4072-4457-ac07-eb55ce76d281 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:21.648581 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9bd30232-4072-4457-ac07-eb55ce76d281 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1737 microversion: 2.1 time: 0.166368 Jul 20 08:32:21.649166 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 394/799] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:21 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:22.033288 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-81031486-7ac5-4ba8-9ab1-9e81d0bc8d2b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:22.033895 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-81031486-7ac5-4ba8-9ab1-9e81d0bc8d2b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:22.039968 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-81031486-7ac5-4ba8-9ab1-9e81d0bc8d2b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:22.040420 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-81031486-7ac5-4ba8-9ab1-9e81d0bc8d2b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:22.041188 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-81031486-7ac5-4ba8-9ab1-9e81d0bc8d2b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:22.041632 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-81031486-7ac5-4ba8-9ab1-9e81d0bc8d2b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:22.178419 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-81031486-7ac5-4ba8-9ab1-9e81d0bc8d2b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:22.186880 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-81031486-7ac5-4ba8-9ab1-9e81d0bc8d2b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:22.188357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-81031486-7ac5-4ba8-9ab1-9e81d0bc8d2b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:22.189487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-81031486-7ac5-4ba8-9ab1-9e81d0bc8d2b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.160436 Jul 20 08:32:22.190043 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 406/800] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:22 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:22.666936 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b5dfeb96-47e6-4d91-9dd8-0e758bdb4cf5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:22.667567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b5dfeb96-47e6-4d91-9dd8-0e758bdb4cf5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:22.673746 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b5dfeb96-47e6-4d91-9dd8-0e758bdb4cf5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:22.674187 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b5dfeb96-47e6-4d91-9dd8-0e758bdb4cf5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:22.674968 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b5dfeb96-47e6-4d91-9dd8-0e758bdb4cf5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:22.675392 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b5dfeb96-47e6-4d91-9dd8-0e758bdb4cf5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:22.805894 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b5dfeb96-47e6-4d91-9dd8-0e758bdb4cf5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:22.814569 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b5dfeb96-47e6-4d91-9dd8-0e758bdb4cf5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1717 microversion: 2.1 time: 0.151629 Jul 20 08:32:22.815162 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 395/801] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:22 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:22.873322 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8fd076e7-115a-4def-aef3-8a406934d043 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:22.873836 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8fd076e7-115a-4def-aef3-8a406934d043 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:22.880039 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8fd076e7-115a-4def-aef3-8a406934d043 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:22.880490 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8fd076e7-115a-4def-aef3-8a406934d043 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:22.881266 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8fd076e7-115a-4def-aef3-8a406934d043 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:22.881707 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8fd076e7-115a-4def-aef3-8a406934d043 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:23.009945 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-8fd076e7-115a-4def-aef3-8a406934d043 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] HTTP exception thrown: Cannot 'detach_volume' instance bd05a594-404a-4d6e-ab1a-ee3aacb3970d while it is in vm_state rescued Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8fd076e7-115a-4def-aef3-8a406934d043 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Request method failure captured: Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: DELETE /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/os-volume_attachments/5aa3260c-5736-488a-8d19-9b856cf84410 HTTP/1.1 Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17wLWBpeoKgfzdsi51_hIXGB8-8_ob4HBeMDTAoZXmbR9OTdLGoz8lraAbtA1VljznsqFm8mBeIJ78unFupJffa1Ph7RVWc5vPV_d-advUcTKgjrXktbtRaRuqi5OFUWnxKh_KRm9Y1lpwiWhLhvcvORrKWnqxeDw0PGarPIqsdcU-4 Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: b044b1d7d5474351bd94eb1c90882933 Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-762570368 Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:32:23.011928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:32:23.013473 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b044b1d7d5474351bd94eb1c90882933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b044b1d7d5474351bd94eb1c90882933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b044b1d7d5474351bd94eb1c90882933", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b044b1d7d5474351bd94eb1c90882933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:32:23.013473 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-ServerRescueNegativeTestJSON-762570368 Jul 20 08:32:23.013473 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: b044b1d7d5474351bd94eb1c90882933 Jul 20 08:32:23.013473 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-762570368 Jul 20 08:32:23.013473 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-ServerRescueNegativeTestJSON-762570368-project Jul 20 08:32:23.013473 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:32:23.013473 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:32:23.013473 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: bdc9e59d03334b72a8052e0f1112523f Jul 20 08:32:23.013473 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-ServerRescueNegativeTestJSON-762570368-project Jul 20 08:32:23.013473 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: > Jul 20 08:32:23.013473 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Cannot 'detach_volume' instance bd05a594-404a-4d6e-ab1a-ee3aacb3970d while it is in vm_state rescued Jul 20 08:32:23.014903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'server_id': 'bd05a594-404a-4d6e-ab1a-ee3aacb3970d', 'id': '5aa3260c-5736-488a-8d19-9b856cf84410'} Jul 20 08:32:23.014903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:32:23.014903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:32:23.014903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 08:32:23.014903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 08:32:23.014903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 08:32:23.014903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 08:32:23.014903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 08:32:23.014903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 08:32:23.014903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bd05a594-404a-4d6e-ab1a-ee3aacb3970d in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 20 08:32:23.014903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:32:23.014903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:32:23.014903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:32:23.014903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:32:23.014903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:32:23.014903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:32:23.014903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:32:23.014903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:32:23.014903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:32:23.014903 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:32:23.016410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 20 08:32:23.016410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 08:32:23.016410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 08:32:23.016410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 08:32:23.016410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance bd05a594-404a-4d6e-ab1a-ee3aacb3970d while it is in vm_state rescued Jul 20 08:32:23.016410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:32:23.016410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:32:23.016410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:32:23.016410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:32:23.016410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:32:23.016410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:32:23.016410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:32:23.016410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:32:23.016410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance bd05a594-404a-4d6e-ab1a-ee3aacb3970d while it is in vm_state rescued Jul 20 08:32:23.016410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:32:23.016410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8fd076e7-115a-4def-aef3-8a406934d043 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Returning 409 to user: Cannot 'detach_volume' instance bd05a594-404a-4d6e-ab1a-ee3aacb3970d while it is in vm_state rescued {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:32:23.017579 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8fd076e7-115a-4def-aef3-8a406934d043 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "DELETE /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/os-volume_attachments/5aa3260c-5736-488a-8d19-9b856cf84410" status: 409 len: 152 microversion: 2.1 time: 0.144934 Jul 20 08:32:23.017579 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 407/802] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Jul 20 08:32:22 2022] DELETE /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/os-volume_attachments/5aa3260c-5736-488a-8d19-9b856cf84410 => generated 152 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 08:32:23.025289 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9d117ffd-b301-4926-97f3-ee6761c757d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:32:23.025943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9d117ffd-b301-4926-97f3-ee6761c757d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:23.032126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9d117ffd-b301-4926-97f3-ee6761c757d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:23.032569 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9d117ffd-b301-4926-97f3-ee6761c757d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:23.033338 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9d117ffd-b301-4926-97f3-ee6761c757d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:23.033775 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9d117ffd-b301-4926-97f3-ee6761c757d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:23.101368 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9d117ffd-b301-4926-97f3-ee6761c757d3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "POST /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/action" status: 202 len: 0 microversion: 2.1 time: 0.082104 Jul 20 08:32:23.102189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 396/803] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Jul 20 08:32:23 2022] POST /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:32:23.110630 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-580161d5-671e-4ef9-ac51-d4a194aa3787 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:23.111255 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-580161d5-671e-4ef9-ac51-d4a194aa3787 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:23.118703 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-580161d5-671e-4ef9-ac51-d4a194aa3787 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:23.119155 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-580161d5-671e-4ef9-ac51-d4a194aa3787 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:23.119926 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-580161d5-671e-4ef9-ac51-d4a194aa3787 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:23.120362 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-580161d5-671e-4ef9-ac51-d4a194aa3787 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:23.209891 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1326609f-7834-4a3a-9e7f-c129d577d74d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:23.210718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1326609f-7834-4a3a-9e7f-c129d577d74d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:23.217797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1326609f-7834-4a3a-9e7f-c129d577d74d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:23.218332 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1326609f-7834-4a3a-9e7f-c129d577d74d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:23.219247 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1326609f-7834-4a3a-9e7f-c129d577d74d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:23.219686 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1326609f-7834-4a3a-9e7f-c129d577d74d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:23.224158 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:32:23.259198 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-580161d5-671e-4ef9-ac51-d4a194aa3787 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:23.269322 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-580161d5-671e-4ef9-ac51-d4a194aa3787 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1725 microversion: 2.1 time: 0.162426 Jul 20 08:32:23.269913 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 408/804] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:23 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:23.361053 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1326609f-7834-4a3a-9e7f-c129d577d74d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:23.370410 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1326609f-7834-4a3a-9e7f-c129d577d74d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:23.372037 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1326609f-7834-4a3a-9e7f-c129d577d74d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:23.373210 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1326609f-7834-4a3a-9e7f-c129d577d74d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.167661 Jul 20 08:32:23.373779 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 397/805] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:23 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:32:24.287672 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-04035fd6-49b8-4bfb-80a3-677bb561b32e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:24.288198 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-04035fd6-49b8-4bfb-80a3-677bb561b32e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:24.295468 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-04035fd6-49b8-4bfb-80a3-677bb561b32e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:24.295916 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-04035fd6-49b8-4bfb-80a3-677bb561b32e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:24.296691 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-04035fd6-49b8-4bfb-80a3-677bb561b32e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:24.297126 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-04035fd6-49b8-4bfb-80a3-677bb561b32e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:24.392515 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-76b9f9b9-06d2-480c-ad8f-5add140ccd8e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:24.393235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-76b9f9b9-06d2-480c-ad8f-5add140ccd8e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:24.400121 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-76b9f9b9-06d2-480c-ad8f-5add140ccd8e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:24.400570 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-76b9f9b9-06d2-480c-ad8f-5add140ccd8e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:24.401417 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-76b9f9b9-06d2-480c-ad8f-5add140ccd8e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:24.401810 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-76b9f9b9-06d2-480c-ad8f-5add140ccd8e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:24.428086 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-04035fd6-49b8-4bfb-80a3-677bb561b32e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:24.436186 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-04035fd6-49b8-4bfb-80a3-677bb561b32e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1725 microversion: 2.1 time: 0.152472 Jul 20 08:32:24.436759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 409/806] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:24 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:24.537914 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-76b9f9b9-06d2-480c-ad8f-5add140ccd8e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:24.546348 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-76b9f9b9-06d2-480c-ad8f-5add140ccd8e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:24.547877 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-76b9f9b9-06d2-480c-ad8f-5add140ccd8e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:24.549033 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-76b9f9b9-06d2-480c-ad8f-5add140ccd8e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.160468 Jul 20 08:32:24.549593 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 398/807] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:24 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:32:25.454213 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-db1180aa-349b-4361-b1ed-b8cfee351e15 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:25.454826 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-db1180aa-349b-4361-b1ed-b8cfee351e15 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:25.461354 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-db1180aa-349b-4361-b1ed-b8cfee351e15 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:25.461795 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-db1180aa-349b-4361-b1ed-b8cfee351e15 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:25.462554 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-db1180aa-349b-4361-b1ed-b8cfee351e15 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:25.463018 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-db1180aa-349b-4361-b1ed-b8cfee351e15 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:25.567438 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-07a82cff-7978-40bb-8ce9-bdf50625ff1f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:25.568190 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-07a82cff-7978-40bb-8ce9-bdf50625ff1f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:25.574747 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-07a82cff-7978-40bb-8ce9-bdf50625ff1f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:25.575209 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-07a82cff-7978-40bb-8ce9-bdf50625ff1f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:25.575982 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-07a82cff-7978-40bb-8ce9-bdf50625ff1f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:25.576415 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-07a82cff-7978-40bb-8ce9-bdf50625ff1f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:25.686438 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-db1180aa-349b-4361-b1ed-b8cfee351e15 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:25.695004 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-db1180aa-349b-4361-b1ed-b8cfee351e15 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1725 microversion: 2.1 time: 0.244312 Jul 20 08:32:25.697879 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 410/808] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:25 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1725 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:25.710447 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-07a82cff-7978-40bb-8ce9-bdf50625ff1f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:25.719179 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-07a82cff-7978-40bb-8ce9-bdf50625ff1f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:25.720760 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-07a82cff-7978-40bb-8ce9-bdf50625ff1f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:25.721934 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-07a82cff-7978-40bb-8ce9-bdf50625ff1f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.158373 Jul 20 08:32:25.722765 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 399/809] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:25 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:32:26.712490 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ee024c3f-eb36-4f69-982b-d03bf3f00f89 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:26.713094 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ee024c3f-eb36-4f69-982b-d03bf3f00f89 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:26.720477 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ee024c3f-eb36-4f69-982b-d03bf3f00f89 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:26.720930 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ee024c3f-eb36-4f69-982b-d03bf3f00f89 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:26.721706 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ee024c3f-eb36-4f69-982b-d03bf3f00f89 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:26.722141 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ee024c3f-eb36-4f69-982b-d03bf3f00f89 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:26.726373 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:32:26.741088 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c4067829-df0e-49f1-87f6-325d15b7bc79 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:26.741686 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c4067829-df0e-49f1-87f6-325d15b7bc79 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:26.748278 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c4067829-df0e-49f1-87f6-325d15b7bc79 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:26.748720 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c4067829-df0e-49f1-87f6-325d15b7bc79 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:26.749492 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c4067829-df0e-49f1-87f6-325d15b7bc79 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:26.749924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c4067829-df0e-49f1-87f6-325d15b7bc79 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:26.865839 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ee024c3f-eb36-4f69-982b-d03bf3f00f89 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:26.874434 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ee024c3f-eb36-4f69-982b-d03bf3f00f89 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1725 microversion: 2.1 time: 0.165741 Jul 20 08:32:26.875057 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 411/810] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:26 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:26.903401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c4067829-df0e-49f1-87f6-325d15b7bc79 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:26.912549 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c4067829-df0e-49f1-87f6-325d15b7bc79 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:26.914040 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c4067829-df0e-49f1-87f6-325d15b7bc79 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:26.915231 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c4067829-df0e-49f1-87f6-325d15b7bc79 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.178207 Jul 20 08:32:26.915800 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 400/811] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:26 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:32:27.674290 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-f1b84717-9100-464b-808c-2f4f18e60d28 req-4d90d098-4995-4b3e-a34b-d88d77b7b724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b295e0-508c-4cd5-b18f-3b808c0ff265", "name": "network-vif-plugged", "status": "completed", "tag": "25187f6d-a614-4168-94dd-d0c397aaf6f3"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:32:27.683084 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-f1b84717-9100-464b-808c-2f4f18e60d28 req-4d90d098-4995-4b3e-a34b-d88d77b7b724 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:27.684218 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-f1b84717-9100-464b-808c-2f4f18e60d28 req-4d90d098-4995-4b3e-a34b-d88d77b7b724 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:27.696504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-f1b84717-9100-464b-808c-2f4f18e60d28 req-4d90d098-4995-4b3e-a34b-d88d77b7b724 service nova] Creating event network-vif-plugged:25187f6d-a614-4168-94dd-d0c397aaf6f3 for instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 on hv-cinder-82308 Jul 20 08:32:27.702156 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-f1b84717-9100-464b-808c-2f4f18e60d28 req-4d90d098-4995-4b3e-a34b-d88d77b7b724 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031567 Jul 20 08:32:27.702788 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 412/812] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:32:27.892216 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-20b087de-31f3-4f6e-92d2-632d8d050d13 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:27.892810 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-20b087de-31f3-4f6e-92d2-632d8d050d13 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:27.899297 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-20b087de-31f3-4f6e-92d2-632d8d050d13 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:27.899738 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-20b087de-31f3-4f6e-92d2-632d8d050d13 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:27.900572 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-20b087de-31f3-4f6e-92d2-632d8d050d13 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:27.900985 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-20b087de-31f3-4f6e-92d2-632d8d050d13 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:27.936246 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-88e68b8c-fe3e-4020-95ba-c4e732e1dd10 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:27.937020 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-88e68b8c-fe3e-4020-95ba-c4e732e1dd10 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:27.943603 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-88e68b8c-fe3e-4020-95ba-c4e732e1dd10 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:27.944042 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-88e68b8c-fe3e-4020-95ba-c4e732e1dd10 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:27.944797 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-88e68b8c-fe3e-4020-95ba-c4e732e1dd10 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:27.945219 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-88e68b8c-fe3e-4020-95ba-c4e732e1dd10 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:28.039357 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-20b087de-31f3-4f6e-92d2-632d8d050d13 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:28.047974 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-20b087de-31f3-4f6e-92d2-632d8d050d13 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1725 microversion: 2.1 time: 0.159579 Jul 20 08:32:28.048559 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 401/813] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:27 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:28.083323 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-88e68b8c-fe3e-4020-95ba-c4e732e1dd10 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:28.091919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-88e68b8c-fe3e-4020-95ba-c4e732e1dd10 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:28.093449 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-88e68b8c-fe3e-4020-95ba-c4e732e1dd10 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:28.094663 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-88e68b8c-fe3e-4020-95ba-c4e732e1dd10 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.163776 Jul 20 08:32:28.095226 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 413/814] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:27 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:32:29.065467 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-4719b4dd-c726-4bb8-917f-53de044007e0 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:29.066068 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-4719b4dd-c726-4bb8-917f-53de044007e0 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:29.072588 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4719b4dd-c726-4bb8-917f-53de044007e0 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:29.073037 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4719b4dd-c726-4bb8-917f-53de044007e0 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:29.073801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4719b4dd-c726-4bb8-917f-53de044007e0 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:29.075032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4719b4dd-c726-4bb8-917f-53de044007e0 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:29.113700 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a710c937-1413-4cd7-8120-437f482faad0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:29.115209 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a710c937-1413-4cd7-8120-437f482faad0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:29.123565 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a710c937-1413-4cd7-8120-437f482faad0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:29.124016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a710c937-1413-4cd7-8120-437f482faad0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:29.124824 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a710c937-1413-4cd7-8120-437f482faad0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:29.125260 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a710c937-1413-4cd7-8120-437f482faad0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:29.216214 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-4719b4dd-c726-4bb8-917f-53de044007e0 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:29.224251 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-4719b4dd-c726-4bb8-917f-53de044007e0 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1725 microversion: 2.1 time: 0.162663 Jul 20 08:32:29.224831 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 402/815] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:29 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:32:29.260464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a710c937-1413-4cd7-8120-437f482faad0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:29.269991 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a710c937-1413-4cd7-8120-437f482faad0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:29.271510 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a710c937-1413-4cd7-8120-437f482faad0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:29.272663 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a710c937-1413-4cd7-8120-437f482faad0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.163017 Jul 20 08:32:29.273230 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 414/816] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:29 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:32:30.245832 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-19e5d9da-f67c-41c0-bb08-323fe5434c6c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:30.247079 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-19e5d9da-f67c-41c0-bb08-323fe5434c6c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:30.258707 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-19e5d9da-f67c-41c0-bb08-323fe5434c6c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:30.259441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-19e5d9da-f67c-41c0-bb08-323fe5434c6c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:30.260791 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-19e5d9da-f67c-41c0-bb08-323fe5434c6c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:30.262295 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-19e5d9da-f67c-41c0-bb08-323fe5434c6c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:30.291308 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-aef4ea3e-540e-4b5a-9705-10ab47cd7e39 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:30.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-aef4ea3e-540e-4b5a-9705-10ab47cd7e39 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:30.299319 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aef4ea3e-540e-4b5a-9705-10ab47cd7e39 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:30.299766 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aef4ea3e-540e-4b5a-9705-10ab47cd7e39 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:30.300544 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aef4ea3e-540e-4b5a-9705-10ab47cd7e39 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:30.301069 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aef4ea3e-540e-4b5a-9705-10ab47cd7e39 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:30.437796 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-19e5d9da-f67c-41c0-bb08-323fe5434c6c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:30.446779 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-19e5d9da-f67c-41c0-bb08-323fe5434c6c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1731 microversion: 2.1 time: 0.207916 Jul 20 08:32:30.447425 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 403/817] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:32:30 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1731 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:32:30.468883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-49b8e972-37ed-4f77-b0a3-22daae63fea3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:30.469764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-49b8e972-37ed-4f77-b0a3-22daae63fea3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:30.479200 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-49b8e972-37ed-4f77-b0a3-22daae63fea3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:30.479643 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-49b8e972-37ed-4f77-b0a3-22daae63fea3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:30.480636 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-49b8e972-37ed-4f77-b0a3-22daae63fea3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:30.481207 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-49b8e972-37ed-4f77-b0a3-22daae63fea3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:30.579560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-49b8e972-37ed-4f77-b0a3-22daae63fea3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118539 Jul 20 08:32:30.580239 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 404/818] 10.222.0.64 () {58 vars in 1274 bytes} [Wed Jul 20 08:32:30 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:32:30.756022 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-aef4ea3e-540e-4b5a-9705-10ab47cd7e39 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:30.767431 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-aef4ea3e-540e-4b5a-9705-10ab47cd7e39 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:30.768915 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-aef4ea3e-540e-4b5a-9705-10ab47cd7e39 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:30.770082 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-aef4ea3e-540e-4b5a-9705-10ab47cd7e39 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.483248 Jul 20 08:32:30.771602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 415/819] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:30 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:31.790438 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-04bf25a7-1c2b-41d0-b3a8-0b0cefc374d5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:31.791389 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-04bf25a7-1c2b-41d0-b3a8-0b0cefc374d5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:31.800186 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-04bf25a7-1c2b-41d0-b3a8-0b0cefc374d5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:31.800735 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-04bf25a7-1c2b-41d0-b3a8-0b0cefc374d5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:31.801742 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-04bf25a7-1c2b-41d0-b3a8-0b0cefc374d5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:31.802334 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-04bf25a7-1c2b-41d0-b3a8-0b0cefc374d5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:31.804375 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-0fee6131-b2c7-46f3-8127-520a57ab51a1 req-e7fb3d68-90fb-4f5b-a196-0f6149788356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd05a594-404a-4d6e-ab1a-ee3aacb3970d", "tag": "3cddf9c2-1c8a-40e4-8522-773a3957740b"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:32:31.820425 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-0fee6131-b2c7-46f3-8127-520a57ab51a1 req-e7fb3d68-90fb-4f5b-a196-0f6149788356 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:31.821548 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-0fee6131-b2c7-46f3-8127-520a57ab51a1 req-e7fb3d68-90fb-4f5b-a196-0f6149788356 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:31.837391 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-0fee6131-b2c7-46f3-8127-520a57ab51a1 req-e7fb3d68-90fb-4f5b-a196-0f6149788356 service nova] Creating event network-changed:3cddf9c2-1c8a-40e4-8522-773a3957740b for instance bd05a594-404a-4d6e-ab1a-ee3aacb3970d on hv-cinder-82308 Jul 20 08:32:31.843491 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-0fee6131-b2c7-46f3-8127-520a57ab51a1 req-e7fb3d68-90fb-4f5b-a196-0f6149788356 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044977 Jul 20 08:32:31.844288 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 416/820] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:32:31.986156 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-04bf25a7-1c2b-41d0-b3a8-0b0cefc374d5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:31.994956 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-04bf25a7-1c2b-41d0-b3a8-0b0cefc374d5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:31.996917 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-04bf25a7-1c2b-41d0-b3a8-0b0cefc374d5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:31.998171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-04bf25a7-1c2b-41d0-b3a8-0b0cefc374d5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.212436 Jul 20 08:32:31.999069 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 405/821] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:31 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:33.018437 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a0ea5996-7d03-4c02-bf34-8345332a6910 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:33.019152 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a0ea5996-7d03-4c02-bf34-8345332a6910 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:33.025974 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a0ea5996-7d03-4c02-bf34-8345332a6910 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:33.026419 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a0ea5996-7d03-4c02-bf34-8345332a6910 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:33.027275 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a0ea5996-7d03-4c02-bf34-8345332a6910 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:33.027783 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a0ea5996-7d03-4c02-bf34-8345332a6910 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:33.158511 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a0ea5996-7d03-4c02-bf34-8345332a6910 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:33.166962 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a0ea5996-7d03-4c02-bf34-8345332a6910 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:33.169170 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a0ea5996-7d03-4c02-bf34-8345332a6910 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:33.170356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a0ea5996-7d03-4c02-bf34-8345332a6910 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.156150 Jul 20 08:32:33.170953 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 417/822] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:33 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:33.858370 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-aa875a0d-3941-4f17-99e0-eb345d34393d req-46347bbc-d1d5-4896-a108-7e95b2671927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd05a594-404a-4d6e-ab1a-ee3aacb3970d", "tag": "3cddf9c2-1c8a-40e4-8522-773a3957740b"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:32:33.867084 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-aa875a0d-3941-4f17-99e0-eb345d34393d req-46347bbc-d1d5-4896-a108-7e95b2671927 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:33.867520 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-aa875a0d-3941-4f17-99e0-eb345d34393d req-46347bbc-d1d5-4896-a108-7e95b2671927 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:33.879020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-aa875a0d-3941-4f17-99e0-eb345d34393d req-46347bbc-d1d5-4896-a108-7e95b2671927 service nova] Creating event network-changed:3cddf9c2-1c8a-40e4-8522-773a3957740b for instance bd05a594-404a-4d6e-ab1a-ee3aacb3970d on hv-cinder-82308 Jul 20 08:32:33.884135 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-aa875a0d-3941-4f17-99e0-eb345d34393d req-46347bbc-d1d5-4896-a108-7e95b2671927 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030306 Jul 20 08:32:33.884731 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 406/823] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:32:34.189607 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-641dc9ad-52a3-4aac-8e22-5151360788dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:34.190202 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-641dc9ad-52a3-4aac-8e22-5151360788dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:34.196787 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-641dc9ad-52a3-4aac-8e22-5151360788dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:34.197226 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-641dc9ad-52a3-4aac-8e22-5151360788dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:34.198010 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-641dc9ad-52a3-4aac-8e22-5151360788dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:34.198442 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-641dc9ad-52a3-4aac-8e22-5151360788dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:34.421879 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-641dc9ad-52a3-4aac-8e22-5151360788dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:34.430217 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-641dc9ad-52a3-4aac-8e22-5151360788dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:34.431831 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-641dc9ad-52a3-4aac-8e22-5151360788dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:34.432881 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-641dc9ad-52a3-4aac-8e22-5151360788dd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.247276 Jul 20 08:32:34.433953 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 418/824] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:34 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:35.452964 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-bb5e7b99-ec49-4301-ba1c-0bb31e5fadb8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:35.453658 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-bb5e7b99-ec49-4301-ba1c-0bb31e5fadb8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:35.460423 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bb5e7b99-ec49-4301-ba1c-0bb31e5fadb8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:35.460874 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bb5e7b99-ec49-4301-ba1c-0bb31e5fadb8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:35.461643 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bb5e7b99-ec49-4301-ba1c-0bb31e5fadb8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:35.462080 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bb5e7b99-ec49-4301-ba1c-0bb31e5fadb8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:35.594797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-bb5e7b99-ec49-4301-ba1c-0bb31e5fadb8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:35.603262 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-bb5e7b99-ec49-4301-ba1c-0bb31e5fadb8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:35.604762 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-bb5e7b99-ec49-4301-ba1c-0bb31e5fadb8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:35.606535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-bb5e7b99-ec49-4301-ba1c-0bb31e5fadb8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1810 microversion: 2.20 time: 0.157985 Jul 20 08:32:35.607125 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 407/825] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:35 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:32:36.625741 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-77b4fc33-6948-42ad-aac4-1383c024692e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:32:36.626337 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-77b4fc33-6948-42ad-aac4-1383c024692e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:32:36.628954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=56 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:32:36.634323 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-77b4fc33-6948-42ad-aac4-1383c024692e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:36.634808 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-77b4fc33-6948-42ad-aac4-1383c024692e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:36.635584 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-77b4fc33-6948-42ad-aac4-1383c024692e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:32:36.636045 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-77b4fc33-6948-42ad-aac4-1383c024692e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:32:36.769766 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-77b4fc33-6948-42ad-aac4-1383c024692e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:36.779168 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-77b4fc33-6948-42ad-aac4-1383c024692e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:36.780691 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-77b4fc33-6948-42ad-aac4-1383c024692e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:32:36.781901 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-77b4fc33-6948-42ad-aac4-1383c024692e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1797 microversion: 2.20 time: 0.160402 Jul 20 08:32:36.782468 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 419/826] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:32:36 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1797 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:33:25.646518 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b135cf02-e9eb-4e9c-a156-7c3e474dec72 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:25.647162 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b135cf02-e9eb-4e9c-a156-7c3e474dec72 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:25.649301 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=41 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:33:25.650057 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=58 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:33:25.655834 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b135cf02-e9eb-4e9c-a156-7c3e474dec72 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:25.656282 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b135cf02-e9eb-4e9c-a156-7c3e474dec72 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:25.657086 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b135cf02-e9eb-4e9c-a156-7c3e474dec72 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:25.657542 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b135cf02-e9eb-4e9c-a156-7c3e474dec72 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:25.786893 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.objects.instance [None req-b135cf02-e9eb-4e9c-a156-7c3e474dec72 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lazy-loading 'services' on Instance uuid c374291c-87f7-45dd-9391-807207d937bc {{(pid=117828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:33:25.902419 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b135cf02-e9eb-4e9c-a156-7c3e474dec72 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc/os-volume_attachments/9b32370d-01d8-4167-b35e-cc292d59beb9" status: 202 len: 0 microversion: 2.1 time: 0.259739 Jul 20 08:33:25.903002 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 408/827] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Jul 20 08:33:25 2022] DELETE /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc/os-volume_attachments/9b32370d-01d8-4167-b35e-cc292d59beb9 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:33:28.066798 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-922ead9d-d025-47c1-8465-1c91d85fbac1 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:33:28.069083 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:33:28.069733 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=44 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:33:28.076381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-922ead9d-d025-47c1-8465-1c91d85fbac1 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:28.076858 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-922ead9d-d025-47c1-8465-1c91d85fbac1 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:28.099456 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-922ead9d-d025-47c1-8465-1c91d85fbac1 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Going to try to stop instance {{(pid=117829) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 08:33:28.146571 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-922ead9d-d025-47c1-8465-1c91d85fbac1 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "POST /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc/action" status: 202 len: 0 microversion: 2.1 time: 0.083395 Jul 20 08:33:28.147301 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 420/828] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Jul 20 08:33:28 2022] POST /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:33:28.156321 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ae1b843e-eb6d-4047-a572-5c9350158854 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:28.157008 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ae1b843e-eb6d-4047-a572-5c9350158854 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:28.164030 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ae1b843e-eb6d-4047-a572-5c9350158854 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:28.164476 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ae1b843e-eb6d-4047-a572-5c9350158854 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:28.165327 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ae1b843e-eb6d-4047-a572-5c9350158854 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:28.165814 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ae1b843e-eb6d-4047-a572-5c9350158854 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:28.301807 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ae1b843e-eb6d-4047-a572-5c9350158854 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:28.310513 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ae1b843e-eb6d-4047-a572-5c9350158854 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1677 microversion: 2.1 time: 0.158019 Jul 20 08:33:28.311127 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 409/829] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:28 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:29.329126 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-1f189e6e-5c30-4585-a64f-108e4cfea626 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:29.329813 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-1f189e6e-5c30-4585-a64f-108e4cfea626 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:29.336062 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1f189e6e-5c30-4585-a64f-108e4cfea626 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:29.336511 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1f189e6e-5c30-4585-a64f-108e4cfea626 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:29.337281 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1f189e6e-5c30-4585-a64f-108e4cfea626 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:29.337726 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1f189e6e-5c30-4585-a64f-108e4cfea626 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:29.470838 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1f189e6e-5c30-4585-a64f-108e4cfea626 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:29.478197 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-1f189e6e-5c30-4585-a64f-108e4cfea626 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1677 microversion: 2.1 time: 0.153953 Jul 20 08:33:29.478781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 421/830] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:29 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:30.496947 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f8d0bb5e-2fde-4c78-bb45-625d013f6e42 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:30.497603 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f8d0bb5e-2fde-4c78-bb45-625d013f6e42 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:30.504616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f8d0bb5e-2fde-4c78-bb45-625d013f6e42 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:30.505057 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f8d0bb5e-2fde-4c78-bb45-625d013f6e42 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:30.505812 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f8d0bb5e-2fde-4c78-bb45-625d013f6e42 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:30.506239 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f8d0bb5e-2fde-4c78-bb45-625d013f6e42 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:30.639172 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f8d0bb5e-2fde-4c78-bb45-625d013f6e42 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:30.646605 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f8d0bb5e-2fde-4c78-bb45-625d013f6e42 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1677 microversion: 2.1 time: 0.154176 Jul 20 08:33:30.647185 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 410/831] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:30 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:31.664160 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4f781bb0-700f-4954-a3be-0d7fe23d312a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:31.664780 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4f781bb0-700f-4954-a3be-0d7fe23d312a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:31.672333 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4f781bb0-700f-4954-a3be-0d7fe23d312a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:31.672773 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4f781bb0-700f-4954-a3be-0d7fe23d312a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:31.673526 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4f781bb0-700f-4954-a3be-0d7fe23d312a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:31.673954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4f781bb0-700f-4954-a3be-0d7fe23d312a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:31.806759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4f781bb0-700f-4954-a3be-0d7fe23d312a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:31.815010 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4f781bb0-700f-4954-a3be-0d7fe23d312a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1677 microversion: 2.1 time: 0.154632 Jul 20 08:33:31.815591 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 422/832] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:31 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:32.832331 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-034df7d1-7bbb-4f2e-aba1-36efe66240c8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:32.832965 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-034df7d1-7bbb-4f2e-aba1-36efe66240c8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:32.839483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-034df7d1-7bbb-4f2e-aba1-36efe66240c8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:32.839984 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-034df7d1-7bbb-4f2e-aba1-36efe66240c8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:32.840697 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-034df7d1-7bbb-4f2e-aba1-36efe66240c8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:32.841815 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-034df7d1-7bbb-4f2e-aba1-36efe66240c8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:32.973339 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-034df7d1-7bbb-4f2e-aba1-36efe66240c8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:32.980720 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-034df7d1-7bbb-4f2e-aba1-36efe66240c8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1677 microversion: 2.1 time: 0.152327 Jul 20 08:33:32.981285 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 411/833] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:32 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:33.999011 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5374780c-1e2c-4194-ace1-88779722b6d9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:33.999636 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5374780c-1e2c-4194-ace1-88779722b6d9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:34.006222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5374780c-1e2c-4194-ace1-88779722b6d9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:34.006704 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5374780c-1e2c-4194-ace1-88779722b6d9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:34.007510 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5374780c-1e2c-4194-ace1-88779722b6d9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:34.007946 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5374780c-1e2c-4194-ace1-88779722b6d9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:34.143334 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5374780c-1e2c-4194-ace1-88779722b6d9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:34.151033 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5374780c-1e2c-4194-ace1-88779722b6d9 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1677 microversion: 2.1 time: 0.156473 Jul 20 08:33:34.151638 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 423/834] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:33 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:35.168898 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ec4dc7e7-bf31-4e68-a67b-82615444fe9e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:35.169591 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ec4dc7e7-bf31-4e68-a67b-82615444fe9e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:35.176099 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ec4dc7e7-bf31-4e68-a67b-82615444fe9e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:35.176547 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ec4dc7e7-bf31-4e68-a67b-82615444fe9e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:35.177314 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ec4dc7e7-bf31-4e68-a67b-82615444fe9e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:35.177749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ec4dc7e7-bf31-4e68-a67b-82615444fe9e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:35.311464 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ec4dc7e7-bf31-4e68-a67b-82615444fe9e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:35.318983 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ec4dc7e7-bf31-4e68-a67b-82615444fe9e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1677 microversion: 2.1 time: 0.153883 Jul 20 08:33:35.319560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 412/835] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:35 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:36.336306 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8cd830c0-b2ba-4587-8182-e374a0e1e8a3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:36.336911 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8cd830c0-b2ba-4587-8182-e374a0e1e8a3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:36.344235 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8cd830c0-b2ba-4587-8182-e374a0e1e8a3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:36.344683 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8cd830c0-b2ba-4587-8182-e374a0e1e8a3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:36.345450 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8cd830c0-b2ba-4587-8182-e374a0e1e8a3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:36.345882 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8cd830c0-b2ba-4587-8182-e374a0e1e8a3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:36.478710 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8cd830c0-b2ba-4587-8182-e374a0e1e8a3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:36.486308 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8cd830c0-b2ba-4587-8182-e374a0e1e8a3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1677 microversion: 2.1 time: 0.153872 Jul 20 08:33:36.486904 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 424/836] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:36 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:36.721722 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-099674c1-abf1-42e3-8a5b-feb83f40035b tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:33:36.722733 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-099674c1-abf1-42e3-8a5b-feb83f40035b tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:36.729419 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-099674c1-abf1-42e3-8a5b-feb83f40035b tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:36.729855 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-099674c1-abf1-42e3-8a5b-feb83f40035b tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:36.730653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-099674c1-abf1-42e3-8a5b-feb83f40035b tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:36.731082 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-099674c1-abf1-42e3-8a5b-feb83f40035b tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:36.807491 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-099674c1-abf1-42e3-8a5b-feb83f40035b tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "POST /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de/action" status: 202 len: 0 microversion: 2.1 time: 0.089453 Jul 20 08:33:36.808206 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 413/837] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Jul 20 08:33:36 2022] POST /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:33:36.816995 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-cdb24993-b0f2-4c2c-890e-84c020069f16 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:36.817617 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-cdb24993-b0f2-4c2c-890e-84c020069f16 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:36.823603 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cdb24993-b0f2-4c2c-890e-84c020069f16 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:36.824047 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cdb24993-b0f2-4c2c-890e-84c020069f16 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:36.824949 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cdb24993-b0f2-4c2c-890e-84c020069f16 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:36.825445 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cdb24993-b0f2-4c2c-890e-84c020069f16 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:37.029665 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-cdb24993-b0f2-4c2c-890e-84c020069f16 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:37.037752 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-cdb24993-b0f2-4c2c-890e-84c020069f16 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1747 microversion: 2.1 time: 0.224463 Jul 20 08:33:37.038329 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 425/838] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:36 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1747 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:37.504175 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a6f7b8df-ec46-4a7c-9a86-5423ce8b9e1e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:37.504790 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a6f7b8df-ec46-4a7c-9a86-5423ce8b9e1e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:37.511064 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a6f7b8df-ec46-4a7c-9a86-5423ce8b9e1e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:37.511507 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a6f7b8df-ec46-4a7c-9a86-5423ce8b9e1e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:37.512274 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a6f7b8df-ec46-4a7c-9a86-5423ce8b9e1e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:37.512708 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a6f7b8df-ec46-4a7c-9a86-5423ce8b9e1e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:37.660485 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a6f7b8df-ec46-4a7c-9a86-5423ce8b9e1e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:37.668283 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a6f7b8df-ec46-4a7c-9a86-5423ce8b9e1e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1677 microversion: 2.1 time: 0.168411 Jul 20 08:33:37.668943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 414/839] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:37 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:38.056699 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-64531d3c-d231-423a-863c-31ed3eb4d516 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:38.057310 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-64531d3c-d231-423a-863c-31ed3eb4d516 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:38.064746 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-64531d3c-d231-423a-863c-31ed3eb4d516 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:38.065197 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-64531d3c-d231-423a-863c-31ed3eb4d516 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:38.065976 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-64531d3c-d231-423a-863c-31ed3eb4d516 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:38.066412 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-64531d3c-d231-423a-863c-31ed3eb4d516 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:38.229856 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-64531d3c-d231-423a-863c-31ed3eb4d516 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:38.239572 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-64531d3c-d231-423a-863c-31ed3eb4d516 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1752 microversion: 2.1 time: 0.186696 Jul 20 08:33:38.240161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 426/840] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:38 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1752 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:38.686315 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-408fde4d-7a5b-41d6-af77-355d582afa6a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:38.686960 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-408fde4d-7a5b-41d6-af77-355d582afa6a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:38.698218 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-408fde4d-7a5b-41d6-af77-355d582afa6a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:38.699022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-408fde4d-7a5b-41d6-af77-355d582afa6a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:38.700308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-408fde4d-7a5b-41d6-af77-355d582afa6a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:38.701086 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-408fde4d-7a5b-41d6-af77-355d582afa6a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:38.858948 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-408fde4d-7a5b-41d6-af77-355d582afa6a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:38.867389 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-408fde4d-7a5b-41d6-af77-355d582afa6a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1677 microversion: 2.1 time: 0.185026 Jul 20 08:33:38.867994 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 415/841] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:38 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:39.257346 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f5a5e12a-9438-480f-b50e-8f347aa85cfc tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:39.257953 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f5a5e12a-9438-480f-b50e-8f347aa85cfc tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:39.264869 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f5a5e12a-9438-480f-b50e-8f347aa85cfc tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:39.265309 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f5a5e12a-9438-480f-b50e-8f347aa85cfc tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:39.266082 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f5a5e12a-9438-480f-b50e-8f347aa85cfc tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:39.266512 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f5a5e12a-9438-480f-b50e-8f347aa85cfc tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:39.422645 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f5a5e12a-9438-480f-b50e-8f347aa85cfc tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:39.430863 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f5a5e12a-9438-480f-b50e-8f347aa85cfc tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1752 microversion: 2.1 time: 0.177288 Jul 20 08:33:39.431452 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 427/842] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:39 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:39.884149 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-dcfeddce-7ab4-4e9c-8197-15de9f0b76a0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:39.884741 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-dcfeddce-7ab4-4e9c-8197-15de9f0b76a0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:39.892685 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-dcfeddce-7ab4-4e9c-8197-15de9f0b76a0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:39.893130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-dcfeddce-7ab4-4e9c-8197-15de9f0b76a0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:39.893907 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-dcfeddce-7ab4-4e9c-8197-15de9f0b76a0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:39.894337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-dcfeddce-7ab4-4e9c-8197-15de9f0b76a0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:40.033284 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-dcfeddce-7ab4-4e9c-8197-15de9f0b76a0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:40.040694 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-dcfeddce-7ab4-4e9c-8197-15de9f0b76a0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1677 microversion: 2.1 time: 0.160633 Jul 20 08:33:40.041251 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 416/843] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:39 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:40.448153 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-7ab43897-66b8-4a8b-becd-9b8b5fd99170 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:40.448825 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-7ab43897-66b8-4a8b-becd-9b8b5fd99170 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:40.455808 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7ab43897-66b8-4a8b-becd-9b8b5fd99170 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:40.456253 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7ab43897-66b8-4a8b-becd-9b8b5fd99170 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:40.457037 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7ab43897-66b8-4a8b-becd-9b8b5fd99170 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:40.457475 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7ab43897-66b8-4a8b-becd-9b8b5fd99170 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:40.609795 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-7ab43897-66b8-4a8b-becd-9b8b5fd99170 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:40.618342 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-7ab43897-66b8-4a8b-becd-9b8b5fd99170 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1752 microversion: 2.1 time: 0.174001 Jul 20 08:33:40.618993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 428/844] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:40 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:41.057541 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d8db023d-4404-472b-a9f8-036a0e81a1cc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:41.058176 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d8db023d-4404-472b-a9f8-036a0e81a1cc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:41.065595 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d8db023d-4404-472b-a9f8-036a0e81a1cc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:41.066041 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d8db023d-4404-472b-a9f8-036a0e81a1cc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:41.066836 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d8db023d-4404-472b-a9f8-036a0e81a1cc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:41.067276 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d8db023d-4404-472b-a9f8-036a0e81a1cc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:41.199969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d8db023d-4404-472b-a9f8-036a0e81a1cc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:41.208238 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d8db023d-4404-472b-a9f8-036a0e81a1cc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1677 microversion: 2.1 time: 0.154715 Jul 20 08:33:41.208808 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 417/845] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:41 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:41.635185 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-79913641-3c4b-4566-aca0-f52a034c3b58 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:41.635771 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-79913641-3c4b-4566-aca0-f52a034c3b58 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:41.642994 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-79913641-3c4b-4566-aca0-f52a034c3b58 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:41.643439 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-79913641-3c4b-4566-aca0-f52a034c3b58 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:41.644200 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-79913641-3c4b-4566-aca0-f52a034c3b58 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:41.644633 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-79913641-3c4b-4566-aca0-f52a034c3b58 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:41.784646 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-79913641-3c4b-4566-aca0-f52a034c3b58 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:41.792717 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-79913641-3c4b-4566-aca0-f52a034c3b58 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1752 microversion: 2.1 time: 0.161594 Jul 20 08:33:41.793281 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 429/846] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:41 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:42.225811 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-53e0f7bf-578a-417c-ae28-ffd6434642b8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:42.226456 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-53e0f7bf-578a-417c-ae28-ffd6434642b8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:42.234502 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-53e0f7bf-578a-417c-ae28-ffd6434642b8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:42.235139 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-53e0f7bf-578a-417c-ae28-ffd6434642b8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:42.236132 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-53e0f7bf-578a-417c-ae28-ffd6434642b8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:42.236651 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-53e0f7bf-578a-417c-ae28-ffd6434642b8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:42.379427 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-53e0f7bf-578a-417c-ae28-ffd6434642b8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:42.383020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-53e0f7bf-578a-417c-ae28-ffd6434642b8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1677 microversion: 2.1 time: 0.161010 Jul 20 08:33:42.383601 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 418/847] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:42 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:42.811379 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4454b2bf-c79e-4466-a760-578cb2552bac tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:42.811986 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4454b2bf-c79e-4466-a760-578cb2552bac tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:42.818851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4454b2bf-c79e-4466-a760-578cb2552bac tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:42.819290 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4454b2bf-c79e-4466-a760-578cb2552bac tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:42.820046 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4454b2bf-c79e-4466-a760-578cb2552bac tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:42.820471 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4454b2bf-c79e-4466-a760-578cb2552bac tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:43.047166 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4454b2bf-c79e-4466-a760-578cb2552bac tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:43.055346 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4454b2bf-c79e-4466-a760-578cb2552bac tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1752 microversion: 2.1 time: 0.248528 Jul 20 08:33:43.056011 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 430/848] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:42 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1752 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:43.402320 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9be2cc4e-384d-46c4-b322-d6a046eaddfc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:43.402949 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9be2cc4e-384d-46c4-b322-d6a046eaddfc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:43.410462 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9be2cc4e-384d-46c4-b322-d6a046eaddfc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:43.410833 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9be2cc4e-384d-46c4-b322-d6a046eaddfc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:43.411541 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9be2cc4e-384d-46c4-b322-d6a046eaddfc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:43.411974 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9be2cc4e-384d-46c4-b322-d6a046eaddfc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:43.550115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9be2cc4e-384d-46c4-b322-d6a046eaddfc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:43.557575 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9be2cc4e-384d-46c4-b322-d6a046eaddfc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1677 microversion: 2.1 time: 0.159104 Jul 20 08:33:43.558137 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 419/849] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:43 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:33:44.073515 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8bcaf17e-e175-49f2-94ca-81697069ae81 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:44.074118 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8bcaf17e-e175-49f2-94ca-81697069ae81 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:44.081414 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8bcaf17e-e175-49f2-94ca-81697069ae81 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:44.081861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8bcaf17e-e175-49f2-94ca-81697069ae81 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:44.082662 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8bcaf17e-e175-49f2-94ca-81697069ae81 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:44.083098 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8bcaf17e-e175-49f2-94ca-81697069ae81 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:44.225830 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8bcaf17e-e175-49f2-94ca-81697069ae81 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:44.234321 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8bcaf17e-e175-49f2-94ca-81697069ae81 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1752 microversion: 2.1 time: 0.164665 Jul 20 08:33:44.234922 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 431/850] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:44 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:44.576105 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c56e0e17-d068-4be8-9014-65a9cf09b538 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:44.576886 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c56e0e17-d068-4be8-9014-65a9cf09b538 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:44.583928 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c56e0e17-d068-4be8-9014-65a9cf09b538 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:44.584374 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c56e0e17-d068-4be8-9014-65a9cf09b538 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:44.585218 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c56e0e17-d068-4be8-9014-65a9cf09b538 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:44.585651 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c56e0e17-d068-4be8-9014-65a9cf09b538 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:44.726286 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c56e0e17-d068-4be8-9014-65a9cf09b538 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:44.734343 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c56e0e17-d068-4be8-9014-65a9cf09b538 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1654 microversion: 2.1 time: 0.162338 Jul 20 08:33:44.734963 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 420/851] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:44 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1654 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:44.751523 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-7bf6e0a2-0ef6-4b69-8a29-d2496c37ab49 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:33:44.757789 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7bf6e0a2-0ef6-4b69-8a29-d2496c37ab49 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:44.758326 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7bf6e0a2-0ef6-4b69-8a29-d2496c37ab49 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:44.781518 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-7bf6e0a2-0ef6-4b69-8a29-d2496c37ab49 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Going to try to start instance {{(pid=117829) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 08:33:44.830153 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-7bf6e0a2-0ef6-4b69-8a29-d2496c37ab49 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "POST /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc/action" status: 202 len: 0 microversion: 2.1 time: 0.083156 Jul 20 08:33:44.830728 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 432/852] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Jul 20 08:33:44 2022] POST /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:33:44.838814 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-380b997e-e492-4dc3-a767-5675de5b8970 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:44.839431 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-380b997e-e492-4dc3-a767-5675de5b8970 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:44.845618 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-380b997e-e492-4dc3-a767-5675de5b8970 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:44.846065 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-380b997e-e492-4dc3-a767-5675de5b8970 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:44.847101 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-380b997e-e492-4dc3-a767-5675de5b8970 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:44.847537 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-380b997e-e492-4dc3-a767-5675de5b8970 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:44.987247 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-380b997e-e492-4dc3-a767-5675de5b8970 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:44.995443 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-380b997e-e492-4dc3-a767-5675de5b8970 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1663 microversion: 2.1 time: 0.160439 Jul 20 08:33:44.996035 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 421/853] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:44 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:45.253286 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-bec23bb1-cf61-4af4-aaca-6cbec8dbc5f0 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:45.254075 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-bec23bb1-cf61-4af4-aaca-6cbec8dbc5f0 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:45.260943 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bec23bb1-cf61-4af4-aaca-6cbec8dbc5f0 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:45.261384 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bec23bb1-cf61-4af4-aaca-6cbec8dbc5f0 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:45.262151 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bec23bb1-cf61-4af4-aaca-6cbec8dbc5f0 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:45.262607 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bec23bb1-cf61-4af4-aaca-6cbec8dbc5f0 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:45.506223 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-bec23bb1-cf61-4af4-aaca-6cbec8dbc5f0 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:45.515190 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-bec23bb1-cf61-4af4-aaca-6cbec8dbc5f0 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1752 microversion: 2.1 time: 0.266345 Jul 20 08:33:45.515770 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 433/854] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:45 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1752 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:46.013877 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e8a4036f-7615-4c36-a18c-9122b96f781d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:46.014817 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-e8a4036f-7615-4c36-a18c-9122b96f781d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:46.021422 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e8a4036f-7615-4c36-a18c-9122b96f781d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:46.021934 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e8a4036f-7615-4c36-a18c-9122b96f781d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:46.022743 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e8a4036f-7615-4c36-a18c-9122b96f781d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:46.023179 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e8a4036f-7615-4c36-a18c-9122b96f781d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:46.154310 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e8a4036f-7615-4c36-a18c-9122b96f781d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:46.157939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:33:46.163260 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e8a4036f-7615-4c36-a18c-9122b96f781d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1663 microversion: 2.1 time: 0.153664 Jul 20 08:33:46.163835 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 422/855] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:46 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1663 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:46.533307 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-bb4e62c7-65ac-4748-995a-85303431023b tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:46.533912 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-bb4e62c7-65ac-4748-995a-85303431023b tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:46.540783 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bb4e62c7-65ac-4748-995a-85303431023b tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:46.541232 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bb4e62c7-65ac-4748-995a-85303431023b tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:46.541998 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bb4e62c7-65ac-4748-995a-85303431023b tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:46.542437 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bb4e62c7-65ac-4748-995a-85303431023b tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:46.560321 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:33:46.687501 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-bb4e62c7-65ac-4748-995a-85303431023b tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:46.695535 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-bb4e62c7-65ac-4748-995a-85303431023b tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1752 microversion: 2.1 time: 0.166705 Jul 20 08:33:46.696103 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 434/856] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:46 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:47.181308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b9a573d2-ff6d-4360-8ff3-067e03f6b8e0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:47.181903 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b9a573d2-ff6d-4360-8ff3-067e03f6b8e0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:47.189714 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b9a573d2-ff6d-4360-8ff3-067e03f6b8e0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:47.190159 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b9a573d2-ff6d-4360-8ff3-067e03f6b8e0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:47.190944 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b9a573d2-ff6d-4360-8ff3-067e03f6b8e0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:47.191371 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b9a573d2-ff6d-4360-8ff3-067e03f6b8e0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:47.325227 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b9a573d2-ff6d-4360-8ff3-067e03f6b8e0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:47.332643 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b9a573d2-ff6d-4360-8ff3-067e03f6b8e0 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1667 microversion: 2.1 time: 0.155302 Jul 20 08:33:47.333216 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 423/857] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:47 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:47.714056 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5218c7c0-95dd-4f44-a1cc-2de504e4a7b2 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:47.714696 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5218c7c0-95dd-4f44-a1cc-2de504e4a7b2 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:47.721968 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5218c7c0-95dd-4f44-a1cc-2de504e4a7b2 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:47.722412 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5218c7c0-95dd-4f44-a1cc-2de504e4a7b2 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:47.723210 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5218c7c0-95dd-4f44-a1cc-2de504e4a7b2 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:47.723648 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5218c7c0-95dd-4f44-a1cc-2de504e4a7b2 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:47.870042 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5218c7c0-95dd-4f44-a1cc-2de504e4a7b2 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:47.878205 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5218c7c0-95dd-4f44-a1cc-2de504e4a7b2 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1752 microversion: 2.1 time: 0.168019 Jul 20 08:33:47.878817 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 435/858] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:47 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:48.895337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-578bc104-2eaa-4e94-b9df-32b9349f893f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:48.896013 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-578bc104-2eaa-4e94-b9df-32b9349f893f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:48.903082 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-578bc104-2eaa-4e94-b9df-32b9349f893f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:48.904456 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-578bc104-2eaa-4e94-b9df-32b9349f893f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:48.904927 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-578bc104-2eaa-4e94-b9df-32b9349f893f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:48.905362 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-578bc104-2eaa-4e94-b9df-32b9349f893f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:49.058010 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-578bc104-2eaa-4e94-b9df-32b9349f893f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:49.066355 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-578bc104-2eaa-4e94-b9df-32b9349f893f tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1752 microversion: 2.1 time: 0.175004 Jul 20 08:33:49.067065 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 424/859] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:48 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:50.084722 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4e7f99b6-fbaa-4e45-a55c-f4491e6eea87 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:50.085324 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4e7f99b6-fbaa-4e45-a55c-f4491e6eea87 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:50.092233 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4e7f99b6-fbaa-4e45-a55c-f4491e6eea87 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:50.092578 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4e7f99b6-fbaa-4e45-a55c-f4491e6eea87 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:50.093389 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4e7f99b6-fbaa-4e45-a55c-f4491e6eea87 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:50.093782 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4e7f99b6-fbaa-4e45-a55c-f4491e6eea87 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:50.240950 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4e7f99b6-fbaa-4e45-a55c-f4491e6eea87 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:50.249780 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4e7f99b6-fbaa-4e45-a55c-f4491e6eea87 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1752 microversion: 2.1 time: 0.169094 Jul 20 08:33:50.250717 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 436/860] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:50 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:51.268310 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-efa44078-4910-45a5-9e01-5335054d59ef tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:51.268917 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-efa44078-4910-45a5-9e01-5335054d59ef tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:51.276732 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-efa44078-4910-45a5-9e01-5335054d59ef tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:51.277081 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-efa44078-4910-45a5-9e01-5335054d59ef tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:51.277863 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-efa44078-4910-45a5-9e01-5335054d59ef tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:51.278291 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-efa44078-4910-45a5-9e01-5335054d59ef tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:51.449668 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-efa44078-4910-45a5-9e01-5335054d59ef tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:51.463630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-efa44078-4910-45a5-9e01-5335054d59ef tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1752 microversion: 2.1 time: 0.200298 Jul 20 08:33:51.464499 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 425/861] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:51 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1752 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:52.483496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-63db77e0-0688-4a36-be21-a9bc6d0a0a91 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:52.484212 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-63db77e0-0688-4a36-be21-a9bc6d0a0a91 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:52.491740 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-63db77e0-0688-4a36-be21-a9bc6d0a0a91 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:52.492265 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-63db77e0-0688-4a36-be21-a9bc6d0a0a91 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:52.493112 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-63db77e0-0688-4a36-be21-a9bc6d0a0a91 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:52.493587 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-63db77e0-0688-4a36-be21-a9bc6d0a0a91 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:52.651173 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-63db77e0-0688-4a36-be21-a9bc6d0a0a91 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:52.660005 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-63db77e0-0688-4a36-be21-a9bc6d0a0a91 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1752 microversion: 2.1 time: 0.181226 Jul 20 08:33:52.660597 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 437/862] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:52 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1752 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:53.677411 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9e59b598-fded-4bbc-bbb2-b12e7dce1597 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:53.678006 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9e59b598-fded-4bbc-bbb2-b12e7dce1597 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:53.684101 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9e59b598-fded-4bbc-bbb2-b12e7dce1597 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:53.684542 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9e59b598-fded-4bbc-bbb2-b12e7dce1597 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:53.685844 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9e59b598-fded-4bbc-bbb2-b12e7dce1597 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:53.686268 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9e59b598-fded-4bbc-bbb2-b12e7dce1597 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:53.839463 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9e59b598-fded-4bbc-bbb2-b12e7dce1597 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:53.848125 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9e59b598-fded-4bbc-bbb2-b12e7dce1597 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1755 microversion: 2.1 time: 0.174634 Jul 20 08:33:53.848601 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 426/863] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:53 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:54.990315 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c2eb2c54-8112-4011-bf00-c98d93969a93 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:54.990971 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c2eb2c54-8112-4011-bf00-c98d93969a93 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:54.997571 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c2eb2c54-8112-4011-bf00-c98d93969a93 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:54.998026 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c2eb2c54-8112-4011-bf00-c98d93969a93 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:54.998836 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c2eb2c54-8112-4011-bf00-c98d93969a93 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:54.999272 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c2eb2c54-8112-4011-bf00-c98d93969a93 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:55.081104 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.objects.instance [None req-c2eb2c54-8112-4011-bf00-c98d93969a93 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lazy-loading 'services' on Instance uuid bd05a594-404a-4d6e-ab1a-ee3aacb3970d {{(pid=117829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:33:55.199709 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c2eb2c54-8112-4011-bf00-c98d93969a93 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "DELETE /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/os-volume_attachments/5aa3260c-5736-488a-8d19-9b856cf84410" status: 202 len: 0 microversion: 2.1 time: 0.213246 Jul 20 08:33:55.200542 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 438/864] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Jul 20 08:33:54 2022] DELETE /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/os-volume_attachments/5aa3260c-5736-488a-8d19-9b856cf84410 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:33:55.210024 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-42205e1d-6aaf-4c43-ac97-feade0b01955 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:55.211276 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-42205e1d-6aaf-4c43-ac97-feade0b01955 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:55.217944 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-42205e1d-6aaf-4c43-ac97-feade0b01955 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:55.218386 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-42205e1d-6aaf-4c43-ac97-feade0b01955 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:55.219201 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-42205e1d-6aaf-4c43-ac97-feade0b01955 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:55.219606 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-42205e1d-6aaf-4c43-ac97-feade0b01955 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:55.250442 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-42205e1d-6aaf-4c43-ac97-feade0b01955 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044983 Jul 20 08:33:55.251040 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 427/865] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Jul 20 08:33:55 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:33:56.263898 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-da459242-23a6-480c-abf3-89dbecc2f3c1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:56.265119 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-da459242-23a6-480c-abf3-89dbecc2f3c1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:56.271641 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-da459242-23a6-480c-abf3-89dbecc2f3c1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:56.272130 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-da459242-23a6-480c-abf3-89dbecc2f3c1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:56.272938 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-da459242-23a6-480c-abf3-89dbecc2f3c1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:56.273379 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-da459242-23a6-480c-abf3-89dbecc2f3c1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:56.306463 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-da459242-23a6-480c-abf3-89dbecc2f3c1 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048055 Jul 20 08:33:56.307075 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 439/866] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Jul 20 08:33:56 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:33:56.970178 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a4efb977-75a9-4cd3-80b9-51bf43a7bf0d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:56.970735 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a4efb977-75a9-4cd3-80b9-51bf43a7bf0d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:56.972918 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=41 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:33:56.978423 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a4efb977-75a9-4cd3-80b9-51bf43a7bf0d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:56.978895 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a4efb977-75a9-4cd3-80b9-51bf43a7bf0d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:56.979662 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a4efb977-75a9-4cd3-80b9-51bf43a7bf0d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:56.980093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a4efb977-75a9-4cd3-80b9-51bf43a7bf0d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:57.010722 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a4efb977-75a9-4cd3-80b9-51bf43a7bf0d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments/86794f20-b5ad-42f6-ac37-0ace454836e6" status: 200 len: 194 microversion: 2.20 time: 0.044762 Jul 20 08:33:57.011328 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 428/867] 10.222.0.64 () {60 vars in 1453 bytes} [Wed Jul 20 08:33:56 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments/86794f20-b5ad-42f6-ac37-0ace454836e6 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:33:57.077902 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-2c4523a6-a99c-438f-a55c-4e10c04e0122 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:57.078392 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-2c4523a6-a99c-438f-a55c-4e10c04e0122 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:57.084607 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2c4523a6-a99c-438f-a55c-4e10c04e0122 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:57.085056 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2c4523a6-a99c-438f-a55c-4e10c04e0122 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:57.085818 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2c4523a6-a99c-438f-a55c-4e10c04e0122 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:57.086247 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2c4523a6-a99c-438f-a55c-4e10c04e0122 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:57.172531 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.objects.instance [None req-2c4523a6-a99c-438f-a55c-4e10c04e0122 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lazy-loading 'services' on Instance uuid 21b295e0-508c-4cd5-b18f-3b808c0ff265 {{(pid=117829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:33:57.246472 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-2c4523a6-a99c-438f-a55c-4e10c04e0122 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "DELETE /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments/86794f20-b5ad-42f6-ac37-0ace454836e6" status: 202 len: 0 microversion: 2.20 time: 0.172450 Jul 20 08:33:57.247111 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 440/868] 10.222.0.64 () {60 vars in 1456 bytes} [Wed Jul 20 08:33:57 2022] DELETE /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments/86794f20-b5ad-42f6-ac37-0ace454836e6 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:33:57.256512 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a3cca17e-aa1d-4de4-b992-e025042cf928 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:57.257426 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a3cca17e-aa1d-4de4-b992-e025042cf928 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:57.265140 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a3cca17e-aa1d-4de4-b992-e025042cf928 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:57.265671 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a3cca17e-aa1d-4de4-b992-e025042cf928 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:57.266537 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a3cca17e-aa1d-4de4-b992-e025042cf928 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:57.267071 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a3cca17e-aa1d-4de4-b992-e025042cf928 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:57.296923 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a3cca17e-aa1d-4de4-b992-e025042cf928 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044522 Jul 20 08:33:57.297698 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 429/869] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Jul 20 08:33:57 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:33:57.319017 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-533bd2d9-988b-4475-937c-ab8d1eb5d27b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:57.320129 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-533bd2d9-988b-4475-937c-ab8d1eb5d27b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:57.326850 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-533bd2d9-988b-4475-937c-ab8d1eb5d27b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:57.327299 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-533bd2d9-988b-4475-937c-ab8d1eb5d27b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:57.328085 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-533bd2d9-988b-4475-937c-ab8d1eb5d27b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:57.328509 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-533bd2d9-988b-4475-937c-ab8d1eb5d27b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:57.358523 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-533bd2d9-988b-4475-937c-ab8d1eb5d27b tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044251 Jul 20 08:33:57.359115 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 441/870] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Jul 20 08:33:57 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 08:33:57.435367 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-bbd133eb-c60e-4fc9-8282-e1bd46ff1096 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:57.435803 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-bbd133eb-c60e-4fc9-8282-e1bd46ff1096 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:57.441870 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bbd133eb-c60e-4fc9-8282-e1bd46ff1096 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:57.442320 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bbd133eb-c60e-4fc9-8282-e1bd46ff1096 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:57.443111 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bbd133eb-c60e-4fc9-8282-e1bd46ff1096 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:57.443547 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bbd133eb-c60e-4fc9-8282-e1bd46ff1096 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:57.467964 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-bbd133eb-c60e-4fc9-8282-e1bd46ff1096 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Going to try to terminate instance {{(pid=117828) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:33:57.541033 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-bbd133eb-c60e-4fc9-8282-e1bd46ff1096 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "DELETE /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 204 len: 0 microversion: 2.1 time: 0.109215 Jul 20 08:33:57.541534 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 430/871] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:33:57 2022] DELETE /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 08:33:57.549993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-841f5139-6606-4472-aa53-e7f179946c1d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:57.550626 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-841f5139-6606-4472-aa53-e7f179946c1d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:57.556520 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-841f5139-6606-4472-aa53-e7f179946c1d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:57.556966 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-841f5139-6606-4472-aa53-e7f179946c1d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:57.557724 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-841f5139-6606-4472-aa53-e7f179946c1d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:57.558159 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-841f5139-6606-4472-aa53-e7f179946c1d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:57.694712 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-841f5139-6606-4472-aa53-e7f179946c1d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:57.702151 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-841f5139-6606-4472-aa53-e7f179946c1d tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1691 microversion: 2.1 time: 0.155958 Jul 20 08:33:57.702733 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 442/872] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:57 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:33:58.310074 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-6f6c5a16-6952-4b2c-9238-a75d96a346ab tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:58.311208 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-6f6c5a16-6952-4b2c-9238-a75d96a346ab tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:58.317918 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6f6c5a16-6952-4b2c-9238-a75d96a346ab tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:58.318360 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6f6c5a16-6952-4b2c-9238-a75d96a346ab tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:58.319156 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6f6c5a16-6952-4b2c-9238-a75d96a346ab tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:58.319582 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6f6c5a16-6952-4b2c-9238-a75d96a346ab tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:58.350386 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-6f6c5a16-6952-4b2c-9238-a75d96a346ab tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045318 Jul 20 08:33:58.350978 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 431/873] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Jul 20 08:33:58 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:33:58.719214 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3e007058-c2eb-41c7-8da5-935f637e7817 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:58.719788 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3e007058-c2eb-41c7-8da5-935f637e7817 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:58.722272 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=47 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:33:58.727756 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3e007058-c2eb-41c7-8da5-935f637e7817 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:58.728204 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3e007058-c2eb-41c7-8da5-935f637e7817 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:58.728976 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3e007058-c2eb-41c7-8da5-935f637e7817 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:58.729412 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3e007058-c2eb-41c7-8da5-935f637e7817 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:58.858354 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3e007058-c2eb-41c7-8da5-935f637e7817 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:58.865726 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3e007058-c2eb-41c7-8da5-935f637e7817 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1691 microversion: 2.1 time: 0.151105 Jul 20 08:33:58.866282 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 443/874] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:58 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:33:59.362747 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-10ce115b-8be4-4c24-9f46-cf7d859b955f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:59.363661 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-10ce115b-8be4-4c24-9f46-cf7d859b955f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:59.370149 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-10ce115b-8be4-4c24-9f46-cf7d859b955f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:59.370623 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-10ce115b-8be4-4c24-9f46-cf7d859b955f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:59.371392 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-10ce115b-8be4-4c24-9f46-cf7d859b955f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:59.371827 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-10ce115b-8be4-4c24-9f46-cf7d859b955f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:59.401271 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-10ce115b-8be4-4c24-9f46-cf7d859b955f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042649 Jul 20 08:33:59.401837 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 432/875] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Jul 20 08:33:59 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:33:59.445083 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5b9d00ed-4777-4a96-8865-1edf4dec09a3 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:59.445570 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5b9d00ed-4777-4a96-8865-1edf4dec09a3 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:59.452043 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5b9d00ed-4777-4a96-8865-1edf4dec09a3 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:59.452496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5b9d00ed-4777-4a96-8865-1edf4dec09a3 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:59.453266 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5b9d00ed-4777-4a96-8865-1edf4dec09a3 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:59.453704 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5b9d00ed-4777-4a96-8865-1edf4dec09a3 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:59.476957 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5b9d00ed-4777-4a96-8865-1edf4dec09a3 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c/ips" status: 200 len: 150 microversion: 2.1 time: 0.035715 Jul 20 08:33:59.477533 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 444/876] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Jul 20 08:33:59 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:33:59.489563 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-4d5effec-5fec-480a-b371-6ed1ec084739 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39f23770-1802-4711-a880-97cedc3327ba"}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:33:59.490635 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-4d5effec-5fec-480a-b371-6ed1ec084739 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:59.496580 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4d5effec-5fec-480a-b371-6ed1ec084739 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:59.497052 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4d5effec-5fec-480a-b371-6ed1ec084739 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:59.498463 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4d5effec-5fec-480a-b371-6ed1ec084739 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:59.498912 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4d5effec-5fec-480a-b371-6ed1ec084739 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:59.580751 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-4d5effec-5fec-480a-b371-6ed1ec084739 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] HTTP exception thrown: Invalid volume: volume 39f23770-1802-4711-a880-97cedc3327ba is already attached to instances: 659d1d17-9163-4971-9ba1-40f3f20d2650 Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-4d5effec-5fec-480a-b371-6ed1ec084739 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Request method failure captured: Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: POST /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c/os-volume_attachments HTTP/1.1 Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 74 Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wixdWG9rc5IFR0aB2pk_ZbXSzHzAQw9OV7xc6ffVi-gC9dtYrya3ESysbvKCfhbC_hvUIb5xnU9fWVg9utseHpLd4EE5IxzuhHoy9DAbH7v7TBBmqEfRBrYIOvZrsS5CsvlsB_ARu1p91yjGC4MVw6_W2whdtfwL_HLJU3zguHAXQ Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:33:59.582616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:33:59.585020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60ee8039b1f4461c996165d5801b91f1", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:33:59.585020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:33:59.585020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:33:59.585020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:33:59.585020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:33:59.585020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:33:59.585020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:33:59.585020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: e6c2070c6d2a450c887b8ca6b97c4b38 Jul 20 08:33:59.585020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:33:59.585020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Jul 20 08:33:59.585020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {"volumeAttachment": {"volumeId": "39f23770-1802-4711-a880-97cedc3327ba"}} Jul 20 08:33:59.585020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:33:59.586189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Invalid volume: volume 39f23770-1802-4711-a880-97cedc3327ba is already attached to instances: 659d1d17-9163-4971-9ba1-40f3f20d2650 Jul 20 08:33:59.586189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'server_id': '28eb9e1d-9ca5-43a1-8330-ae91249f609c', 'body': {'volumeAttachment': {'volumeId': '39f23770-1802-4711-a880-97cedc3327ba'}}} Jul 20 08:33:59.586189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:33:59.586189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:33:59.586189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 08:33:59.586189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 08:33:59.586189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 08:33:59.586189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 08:33:59.586189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 08:33:59.586189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 08:33:59.586189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 08:33:59.586189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 08:33:59.586189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 08:33:59.586189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 08:33:59.586189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 39f23770-1802-4711-a880-97cedc3327ba is already attached to instances: 659d1d17-9163-4971-9ba1-40f3f20d2650 Jul 20 08:33:59.586189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:33:59.586189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:33:59.586189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:33:59.586189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:33:59.587557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:33:59.587557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:33:59.587557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:33:59.587557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:33:59.587557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:33:59.587557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:33:59.587557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 08:33:59.587557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 08:33:59.587557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 08:33:59.587557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 08:33:59.587557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 08:33:59.587557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 08:33:59.587557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 08:33:59.587557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 08:33:59.587557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 39f23770-1802-4711-a880-97cedc3327ba is already attached to instances: 659d1d17-9163-4971-9ba1-40f3f20d2650 Jul 20 08:33:59.587557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:33:59.587557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:33:59.587557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:33:59.587557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:33:59.587557 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:33:59.588732 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:33:59.588732 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:33:59.588732 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:33:59.588732 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 39f23770-1802-4711-a880-97cedc3327ba is already attached to instances: 659d1d17-9163-4971-9ba1-40f3f20d2650 Jul 20 08:33:59.588732 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:33:59.588732 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-4d5effec-5fec-480a-b371-6ed1ec084739 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Returning 400 to user: Invalid volume: volume 39f23770-1802-4711-a880-97cedc3327ba is already attached to instances: 659d1d17-9163-4971-9ba1-40f3f20d2650 {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:33:59.588732 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-4d5effec-5fec-480a-b371-6ed1ec084739 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "POST /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098520 Jul 20 08:33:59.588732 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 433/877] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Jul 20 08:33:59 2022] POST /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 08:33:59.593796 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-019c9d1f-6b0e-44f0-bf20-191094e88e4f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:59.594375 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-019c9d1f-6b0e-44f0-bf20-191094e88e4f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:59.600666 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-019c9d1f-6b0e-44f0-bf20-191094e88e4f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:59.601230 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-019c9d1f-6b0e-44f0-bf20-191094e88e4f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:59.601995 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-019c9d1f-6b0e-44f0-bf20-191094e88e4f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:59.602418 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-019c9d1f-6b0e-44f0-bf20-191094e88e4f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:59.629417 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-019c9d1f-6b0e-44f0-bf20-191094e88e4f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Going to try to terminate instance {{(pid=117829) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:33:59.702597 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-019c9d1f-6b0e-44f0-bf20-191094e88e4f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "DELETE /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 204 len: 0 microversion: 2.1 time: 0.112687 Jul 20 08:33:59.703212 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 445/878] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:33:59 2022] DELETE /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:33:59.711623 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a73de35a-66c4-4b29-84c3-c4df9774dd38 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:59.712230 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a73de35a-66c4-4b29-84c3-c4df9774dd38 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:59.719576 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a73de35a-66c4-4b29-84c3-c4df9774dd38 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:59.720026 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a73de35a-66c4-4b29-84c3-c4df9774dd38 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:59.720809 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a73de35a-66c4-4b29-84c3-c4df9774dd38 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:59.721227 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a73de35a-66c4-4b29-84c3-c4df9774dd38 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:59.861615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a73de35a-66c4-4b29-84c3-c4df9774dd38 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:33:59.869293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a73de35a-66c4-4b29-84c3-c4df9774dd38 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1682 microversion: 2.1 time: 0.161516 Jul 20 08:33:59.869867 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 434/879] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:59 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:33:59.884544 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4885ded6-5348-4095-bda3-8183c916ba0c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:33:59.885134 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4885ded6-5348-4095-bda3-8183c916ba0c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:33:59.892035 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4885ded6-5348-4095-bda3-8183c916ba0c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:59.892482 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4885ded6-5348-4095-bda3-8183c916ba0c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:33:59.893259 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4885ded6-5348-4095-bda3-8183c916ba0c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:33:59.893689 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4885ded6-5348-4095-bda3-8183c916ba0c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:00.040370 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4885ded6-5348-4095-bda3-8183c916ba0c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:00.047912 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4885ded6-5348-4095-bda3-8183c916ba0c tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1691 microversion: 2.1 time: 0.168251 Jul 20 08:34:00.048484 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 446/880] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:33:59 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:00.413485 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-63071867-1b95-4b29-9e69-d9ae9843802d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:00.414462 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-63071867-1b95-4b29-9e69-d9ae9843802d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:00.421614 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-63071867-1b95-4b29-9e69-d9ae9843802d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:00.422060 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-63071867-1b95-4b29-9e69-d9ae9843802d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:00.422847 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-63071867-1b95-4b29-9e69-d9ae9843802d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:00.423282 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-63071867-1b95-4b29-9e69-d9ae9843802d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:00.452885 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-63071867-1b95-4b29-9e69-d9ae9843802d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043436 Jul 20 08:34:00.453444 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 435/881] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Jul 20 08:34:00 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 08:34:00.887202 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-fee4eaea-89e0-4c5b-bb5a-a8ff3b3156cd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:00.887967 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-fee4eaea-89e0-4c5b-bb5a-a8ff3b3156cd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:00.895314 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fee4eaea-89e0-4c5b-bb5a-a8ff3b3156cd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:00.895760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fee4eaea-89e0-4c5b-bb5a-a8ff3b3156cd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:00.896535 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fee4eaea-89e0-4c5b-bb5a-a8ff3b3156cd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:00.896969 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fee4eaea-89e0-4c5b-bb5a-a8ff3b3156cd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:01.043020 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fee4eaea-89e0-4c5b-bb5a-a8ff3b3156cd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:01.051376 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-fee4eaea-89e0-4c5b-bb5a-a8ff3b3156cd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1682 microversion: 2.1 time: 0.168442 Jul 20 08:34:01.051960 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 447/882] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:00 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:01.065863 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c926d49c-a6b7-4c21-96de-2132c347b96e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:01.066456 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c926d49c-a6b7-4c21-96de-2132c347b96e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:01.072745 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c926d49c-a6b7-4c21-96de-2132c347b96e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:01.073189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c926d49c-a6b7-4c21-96de-2132c347b96e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:01.073966 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c926d49c-a6b7-4c21-96de-2132c347b96e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:01.075108 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c926d49c-a6b7-4c21-96de-2132c347b96e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:01.367424 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c926d49c-a6b7-4c21-96de-2132c347b96e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:01.375276 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c926d49c-a6b7-4c21-96de-2132c347b96e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1691 microversion: 2.1 time: 0.313258 Jul 20 08:34:01.375845 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 436/883] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:01 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1691 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:01.465017 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-eb0f49a7-c262-4a57-9b65-6fe1af788564 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:01.465886 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-eb0f49a7-c262-4a57-9b65-6fe1af788564 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:01.473298 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-eb0f49a7-c262-4a57-9b65-6fe1af788564 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:01.473746 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-eb0f49a7-c262-4a57-9b65-6fe1af788564 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:01.474520 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-eb0f49a7-c262-4a57-9b65-6fe1af788564 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:01.474982 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-eb0f49a7-c262-4a57-9b65-6fe1af788564 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:01.493733 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:34:01.509782 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-eb0f49a7-c262-4a57-9b65-6fe1af788564 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048926 Jul 20 08:34:01.510366 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 448/884] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Jul 20 08:34:01 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:34:01.802454 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-6532cc63-bd1b-4512-8efb-4c18c6a94805 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:01.803039 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-6532cc63-bd1b-4512-8efb-4c18c6a94805 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:01.809617 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6532cc63-bd1b-4512-8efb-4c18c6a94805 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:01.810088 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6532cc63-bd1b-4512-8efb-4c18c6a94805 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:01.810888 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6532cc63-bd1b-4512-8efb-4c18c6a94805 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:01.811343 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6532cc63-bd1b-4512-8efb-4c18c6a94805 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:01.837401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-6532cc63-bd1b-4512-8efb-4c18c6a94805 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Going to try to terminate instance {{(pid=117828) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:34:01.840443 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:34:01.919107 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-6532cc63-bd1b-4512-8efb-4c18c6a94805 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "DELETE /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 204 len: 0 microversion: 2.1 time: 0.120180 Jul 20 08:34:01.919701 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 437/885] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:34:01 2022] DELETE /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:34:01.928477 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5e774013-f73a-4a46-a52d-cf2728d9fdb0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:01.929070 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5e774013-f73a-4a46-a52d-cf2728d9fdb0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:01.936397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5e774013-f73a-4a46-a52d-cf2728d9fdb0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:01.936835 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5e774013-f73a-4a46-a52d-cf2728d9fdb0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:01.937598 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5e774013-f73a-4a46-a52d-cf2728d9fdb0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:01.938025 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5e774013-f73a-4a46-a52d-cf2728d9fdb0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:02.074855 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-2d99dfbb-8215-46d7-8222-1a3dea78d3e4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:02.076654 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-2d99dfbb-8215-46d7-8222-1a3dea78d3e4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:02.087374 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2d99dfbb-8215-46d7-8222-1a3dea78d3e4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:02.088105 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2d99dfbb-8215-46d7-8222-1a3dea78d3e4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:02.088977 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2d99dfbb-8215-46d7-8222-1a3dea78d3e4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:02.089533 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2d99dfbb-8215-46d7-8222-1a3dea78d3e4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:02.097017 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5e774013-f73a-4a46-a52d-cf2728d9fdb0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:02.105249 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5e774013-f73a-4a46-a52d-cf2728d9fdb0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1576 microversion: 2.1 time: 0.180995 Jul 20 08:34:02.114625 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 449/886] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:01 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1576 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:02.232252 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2d99dfbb-8215-46d7-8222-1a3dea78d3e4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:02.240427 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-2d99dfbb-8215-46d7-8222-1a3dea78d3e4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1682 microversion: 2.1 time: 0.173401 Jul 20 08:34:02.241007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 438/887] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:02 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:02.392967 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4f951a9e-765c-4b53-9832-f745597b2cb7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:02.393480 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4f951a9e-765c-4b53-9832-f745597b2cb7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:02.399626 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4f951a9e-765c-4b53-9832-f745597b2cb7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:02.400070 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4f951a9e-765c-4b53-9832-f745597b2cb7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:02.400838 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4f951a9e-765c-4b53-9832-f745597b2cb7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:02.401269 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4f951a9e-765c-4b53-9832-f745597b2cb7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:02.524490 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d56787e4-f1f4-4836-9a04-db08ca8ce0dc tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:02.525553 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d56787e4-f1f4-4836-9a04-db08ca8ce0dc tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:02.532149 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d56787e4-f1f4-4836-9a04-db08ca8ce0dc tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:02.532686 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d56787e4-f1f4-4836-9a04-db08ca8ce0dc tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:02.533473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d56787e4-f1f4-4836-9a04-db08ca8ce0dc tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:02.533918 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d56787e4-f1f4-4836-9a04-db08ca8ce0dc tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:02.541864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4f951a9e-765c-4b53-9832-f745597b2cb7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:02.550637 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4f951a9e-765c-4b53-9832-f745597b2cb7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1691 microversion: 2.1 time: 0.161850 Jul 20 08:34:02.551217 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 450/888] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:02 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:02.566493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d56787e4-f1f4-4836-9a04-db08ca8ce0dc tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046665 Jul 20 08:34:02.567096 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 439/889] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Jul 20 08:34:02 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:34:03.123399 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a76367a1-8d0f-48ca-9c1b-5547bcd583c0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:03.124015 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a76367a1-8d0f-48ca-9c1b-5547bcd583c0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:03.130852 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a76367a1-8d0f-48ca-9c1b-5547bcd583c0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:03.131316 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a76367a1-8d0f-48ca-9c1b-5547bcd583c0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:03.132109 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a76367a1-8d0f-48ca-9c1b-5547bcd583c0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:03.132548 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a76367a1-8d0f-48ca-9c1b-5547bcd583c0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:03.258920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3c015c31-9ec2-4abe-92c6-46e799a9b8c2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:03.259522 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-3c015c31-9ec2-4abe-92c6-46e799a9b8c2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:03.267609 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3c015c31-9ec2-4abe-92c6-46e799a9b8c2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:03.268101 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3c015c31-9ec2-4abe-92c6-46e799a9b8c2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:03.268894 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3c015c31-9ec2-4abe-92c6-46e799a9b8c2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:03.269334 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3c015c31-9ec2-4abe-92c6-46e799a9b8c2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:03.284682 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a76367a1-8d0f-48ca-9c1b-5547bcd583c0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:03.292605 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a76367a1-8d0f-48ca-9c1b-5547bcd583c0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1576 microversion: 2.1 time: 0.173228 Jul 20 08:34:03.293179 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 451/890] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:03 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:03.435577 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3c015c31-9ec2-4abe-92c6-46e799a9b8c2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:03.443677 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-3c015c31-9ec2-4abe-92c6-46e799a9b8c2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1682 microversion: 2.1 time: 0.188587 Jul 20 08:34:03.444700 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 440/891] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:03 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:03.570682 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-653e806a-da08-4b4a-a684-6bc05fc70dbb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:03.571369 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-653e806a-da08-4b4a-a684-6bc05fc70dbb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:03.578210 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7b36aeca-73a5-4438-a4ae-70dafa58aa15 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:03.579210 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-7b36aeca-73a5-4438-a4ae-70dafa58aa15 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:03.581345 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-653e806a-da08-4b4a-a684-6bc05fc70dbb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:03.582135 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-653e806a-da08-4b4a-a684-6bc05fc70dbb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:03.583445 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-653e806a-da08-4b4a-a684-6bc05fc70dbb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:03.583985 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-653e806a-da08-4b4a-a684-6bc05fc70dbb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:03.585616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7b36aeca-73a5-4438-a4ae-70dafa58aa15 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:03.586069 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7b36aeca-73a5-4438-a4ae-70dafa58aa15 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:03.586897 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7b36aeca-73a5-4438-a4ae-70dafa58aa15 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:03.587344 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7b36aeca-73a5-4438-a4ae-70dafa58aa15 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:03.626240 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-7b36aeca-73a5-4438-a4ae-70dafa58aa15 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052077 Jul 20 08:34:03.627601 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 441/892] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Jul 20 08:34:03 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:34:03.755351 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-653e806a-da08-4b4a-a684-6bc05fc70dbb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:03.765166 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-653e806a-da08-4b4a-a684-6bc05fc70dbb tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1691 microversion: 2.1 time: 0.199684 Jul 20 08:34:03.766065 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 452/893] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:03 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1691 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:04.312447 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-77c200c2-28dd-483a-9c95-0bd9104b2494 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:04.313162 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-77c200c2-28dd-483a-9c95-0bd9104b2494 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:04.320376 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-77c200c2-28dd-483a-9c95-0bd9104b2494 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:04.320828 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-77c200c2-28dd-483a-9c95-0bd9104b2494 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:04.321606 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-77c200c2-28dd-483a-9c95-0bd9104b2494 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:04.322047 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-77c200c2-28dd-483a-9c95-0bd9104b2494 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:04.462341 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f21cb1e3-749f-4ab4-a4f4-227b8f7a8bf8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:04.463895 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f21cb1e3-749f-4ab4-a4f4-227b8f7a8bf8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:04.474740 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f21cb1e3-749f-4ab4-a4f4-227b8f7a8bf8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:04.475823 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f21cb1e3-749f-4ab4-a4f4-227b8f7a8bf8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:04.476873 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f21cb1e3-749f-4ab4-a4f4-227b8f7a8bf8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:04.477556 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f21cb1e3-749f-4ab4-a4f4-227b8f7a8bf8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:04.560602 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-77c200c2-28dd-483a-9c95-0bd9104b2494 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:04.576039 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-77c200c2-28dd-483a-9c95-0bd9104b2494 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1576 microversion: 2.1 time: 0.267724 Jul 20 08:34:04.577072 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 442/894] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:04 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1576 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:04.641607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-391bb59f-0fe3-4afa-837a-83200a43a37f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:04.642659 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-391bb59f-0fe3-4afa-837a-83200a43a37f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:04.649891 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-391bb59f-0fe3-4afa-837a-83200a43a37f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:04.650362 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-391bb59f-0fe3-4afa-837a-83200a43a37f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:04.651200 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-391bb59f-0fe3-4afa-837a-83200a43a37f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:04.651629 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-391bb59f-0fe3-4afa-837a-83200a43a37f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:04.713899 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-391bb59f-0fe3-4afa-837a-83200a43a37f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.077210 Jul 20 08:34:04.714751 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 443/895] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Jul 20 08:34:04 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:04.783047 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-778bb24e-712e-4f34-976d-6437f359d783 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:04.783655 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-778bb24e-712e-4f34-976d-6437f359d783 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:04.790347 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-778bb24e-712e-4f34-976d-6437f359d783 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:04.790860 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-778bb24e-712e-4f34-976d-6437f359d783 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:04.791657 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-778bb24e-712e-4f34-976d-6437f359d783 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:04.792094 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-778bb24e-712e-4f34-976d-6437f359d783 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:04.956938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-778bb24e-712e-4f34-976d-6437f359d783 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:04.964561 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-778bb24e-712e-4f34-976d-6437f359d783 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1691 microversion: 2.1 time: 0.185616 Jul 20 08:34:04.971474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 444/896] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:04 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1691 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:04.971474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f86b6ce7-6ec3-45f3-a0ad-809fe3f4e347 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:04.972024 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f86b6ce7-6ec3-45f3-a0ad-809fe3f4e347 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:04.979648 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f86b6ce7-6ec3-45f3-a0ad-809fe3f4e347 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:04.980090 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f86b6ce7-6ec3-45f3-a0ad-809fe3f4e347 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:04.980875 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f86b6ce7-6ec3-45f3-a0ad-809fe3f4e347 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:04.981391 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f86b6ce7-6ec3-45f3-a0ad-809fe3f4e347 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:05.017523 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f86b6ce7-6ec3-45f3-a0ad-809fe3f4e347 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Going to try to terminate instance {{(pid=117828) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:34:05.117616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f86b6ce7-6ec3-45f3-a0ad-809fe3f4e347 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "DELETE /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 204 len: 0 microversion: 2.20 time: 0.150332 Jul 20 08:34:05.118431 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 445/897] 10.222.0.64 () {60 vars in 1279 bytes} [Wed Jul 20 08:34:04 2022] DELETE /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 08:34:05.133533 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9309aa6e-1318-4b45-bdf9-b71e50b1f026 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:05.134887 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9309aa6e-1318-4b45-bdf9-b71e50b1f026 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:05.142328 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9309aa6e-1318-4b45-bdf9-b71e50b1f026 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:05.142822 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9309aa6e-1318-4b45-bdf9-b71e50b1f026 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:05.143614 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9309aa6e-1318-4b45-bdf9-b71e50b1f026 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:05.144052 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9309aa6e-1318-4b45-bdf9-b71e50b1f026 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:05.284942 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9309aa6e-1318-4b45-bdf9-b71e50b1f026 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:05.293800 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9309aa6e-1318-4b45-bdf9-b71e50b1f026 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:05.295864 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9309aa6e-1318-4b45-bdf9-b71e50b1f026 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:05.297025 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9309aa6e-1318-4b45-bdf9-b71e50b1f026 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.171392 Jul 20 08:34:05.297701 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 446/898] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:34:05 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:34:05.313392 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f21cb1e3-749f-4ab4-a4f4-227b8f7a8bf8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:05.322273 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f21cb1e3-749f-4ab4-a4f4-227b8f7a8bf8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1682 microversion: 2.1 time: 0.864638 Jul 20 08:34:05.323159 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 453/899] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:04 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1682 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:05.601665 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8289df33-0c02-4ade-ac8a-79f8da7ca238 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:05.602260 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8289df33-0c02-4ade-ac8a-79f8da7ca238 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:05.609367 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8289df33-0c02-4ade-ac8a-79f8da7ca238 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:05.609863 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8289df33-0c02-4ade-ac8a-79f8da7ca238 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:05.610664 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8289df33-0c02-4ade-ac8a-79f8da7ca238 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:05.611098 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8289df33-0c02-4ade-ac8a-79f8da7ca238 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:05.758323 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-8289df33-0c02-4ade-ac8a-79f8da7ca238 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:05.767681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8289df33-0c02-4ade-ac8a-79f8da7ca238 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1576 microversion: 2.1 time: 0.169945 Jul 20 08:34:05.768810 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 447/900] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:05 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:05.987319 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3c86d0dd-67ad-48cd-a51f-8d8d74edc767 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:05.989313 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3c86d0dd-67ad-48cd-a51f-8d8d74edc767 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:06.001441 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3c86d0dd-67ad-48cd-a51f-8d8d74edc767 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:06.001896 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3c86d0dd-67ad-48cd-a51f-8d8d74edc767 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:06.002702 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3c86d0dd-67ad-48cd-a51f-8d8d74edc767 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:06.003140 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3c86d0dd-67ad-48cd-a51f-8d8d74edc767 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:06.142743 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-ab6d1c26-8c75-47b0-b19a-95ab1a9d456a req-5a208f2b-82b1-465d-b16a-291bce4076cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15050cb9-f79e-4546-b875-1b4e338312fa", "name": "network-vif-unplugged", "status": "completed", "tag": "91e7ab01-3fe6-490c-8584-7db55fc13380"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:06.149750 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3c86d0dd-67ad-48cd-a51f-8d8d74edc767 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:06.171026 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3c86d0dd-67ad-48cd-a51f-8d8d74edc767 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1623 microversion: 2.1 time: 0.190746 Jul 20 08:34:06.175122 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 454/901] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:05 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1623 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:06.182826 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-ab6d1c26-8c75-47b0-b19a-95ab1a9d456a req-5a208f2b-82b1-465d-b16a-291bce4076cb service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:06.187710 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-ab6d1c26-8c75-47b0-b19a-95ab1a9d456a req-5a208f2b-82b1-465d-b16a-291bce4076cb service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:06.201461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-ab6d1c26-8c75-47b0-b19a-95ab1a9d456a req-5a208f2b-82b1-465d-b16a-291bce4076cb service nova] Creating event network-vif-unplugged:91e7ab01-3fe6-490c-8584-7db55fc13380 for instance 15050cb9-f79e-4546-b875-1b4e338312fa on hv-cinder-82308 Jul 20 08:34:06.207193 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-ab6d1c26-8c75-47b0-b19a-95ab1a9d456a req-5a208f2b-82b1-465d-b16a-291bce4076cb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075751 Jul 20 08:34:06.208062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 448/902] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:34:06.317521 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6eb6e038-c05c-44d5-aa7a-12c2d2eebb6c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:06.318219 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6eb6e038-c05c-44d5-aa7a-12c2d2eebb6c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:06.325355 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6eb6e038-c05c-44d5-aa7a-12c2d2eebb6c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:06.326079 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6eb6e038-c05c-44d5-aa7a-12c2d2eebb6c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:06.327005 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6eb6e038-c05c-44d5-aa7a-12c2d2eebb6c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:06.327481 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6eb6e038-c05c-44d5-aa7a-12c2d2eebb6c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:06.345311 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-52f5dd62-6153-4de2-ac3f-9f52b2432e5f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:06.347447 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-52f5dd62-6153-4de2-ac3f-9f52b2432e5f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:06.359787 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-52f5dd62-6153-4de2-ac3f-9f52b2432e5f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:06.361540 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-52f5dd62-6153-4de2-ac3f-9f52b2432e5f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:06.363116 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-52f5dd62-6153-4de2-ac3f-9f52b2432e5f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:06.364482 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-52f5dd62-6153-4de2-ac3f-9f52b2432e5f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:06.479942 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-52f5dd62-6153-4de2-ac3f-9f52b2432e5f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:06.491590 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-52f5dd62-6153-4de2-ac3f-9f52b2432e5f tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1614 microversion: 2.1 time: 0.153974 Jul 20 08:34:06.492353 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 449/903] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:06 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1614 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:06.785999 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0fe189fe-aa13-40b0-a1df-0e2af4d3b31b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:06.787337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0fe189fe-aa13-40b0-a1df-0e2af4d3b31b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:06.794130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0fe189fe-aa13-40b0-a1df-0e2af4d3b31b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:06.794838 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0fe189fe-aa13-40b0-a1df-0e2af4d3b31b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:06.795802 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0fe189fe-aa13-40b0-a1df-0e2af4d3b31b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:06.796391 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0fe189fe-aa13-40b0-a1df-0e2af4d3b31b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:06.797805 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6eb6e038-c05c-44d5-aa7a-12c2d2eebb6c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:06.829917 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6eb6e038-c05c-44d5-aa7a-12c2d2eebb6c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:06.831589 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6eb6e038-c05c-44d5-aa7a-12c2d2eebb6c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:06.832821 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6eb6e038-c05c-44d5-aa7a-12c2d2eebb6c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.519661 Jul 20 08:34:06.843763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 455/904] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:34:06 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:34:06.891676 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-0fe189fe-aa13-40b0-a1df-0e2af4d3b31b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:06.900876 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0fe189fe-aa13-40b0-a1df-0e2af4d3b31b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1508 microversion: 2.1 time: 0.118922 Jul 20 08:34:06.901833 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 450/905] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:06 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1508 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:07.189659 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f2435795-245d-44ee-a898-1d9ba19a91ee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:07.190843 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f2435795-245d-44ee-a898-1d9ba19a91ee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:07.198408 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f2435795-245d-44ee-a898-1d9ba19a91ee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:07.198659 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-49828f52-e4ac-4c7a-b179-7c9b49f75f37 req-9336c531-1b18-4c3c-9137-579ab464bc39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd05a594-404a-4d6e-ab1a-ee3aacb3970d", "name": "network-vif-deleted", "tag": "3cddf9c2-1c8a-40e4-8522-773a3957740b"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:07.199283 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f2435795-245d-44ee-a898-1d9ba19a91ee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:07.200161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f2435795-245d-44ee-a898-1d9ba19a91ee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:07.201616 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f2435795-245d-44ee-a898-1d9ba19a91ee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:07.215254 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-49828f52-e4ac-4c7a-b179-7c9b49f75f37 req-9336c531-1b18-4c3c-9137-579ab464bc39 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:07.215785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-49828f52-e4ac-4c7a-b179-7c9b49f75f37 req-9336c531-1b18-4c3c-9137-579ab464bc39 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:07.238617 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-49828f52-e4ac-4c7a-b179-7c9b49f75f37 req-9336c531-1b18-4c3c-9137-579ab464bc39 service nova] Creating event network-vif-deleted:3cddf9c2-1c8a-40e4-8522-773a3957740b for instance bd05a594-404a-4d6e-ab1a-ee3aacb3970d on hv-cinder-82308 Jul 20 08:34:07.252357 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-49828f52-e4ac-4c7a-b179-7c9b49f75f37 req-9336c531-1b18-4c3c-9137-579ab464bc39 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057877 Jul 20 08:34:07.252964 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 451/906] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:34:07.330808 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f2435795-245d-44ee-a898-1d9ba19a91ee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:07.356634 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f2435795-245d-44ee-a898-1d9ba19a91ee tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1623 microversion: 2.1 time: 0.172426 Jul 20 08:34:07.359711 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 456/907] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:07 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1623 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:07.511194 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1ed4c3ab-4d8f-4bb6-ae8d-db1e43f190f3 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:07.511962 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1ed4c3ab-4d8f-4bb6-ae8d-db1e43f190f3 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:07.530130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1ed4c3ab-4d8f-4bb6-ae8d-db1e43f190f3 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:07.530976 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1ed4c3ab-4d8f-4bb6-ae8d-db1e43f190f3 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:07.539152 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1ed4c3ab-4d8f-4bb6-ae8d-db1e43f190f3 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:07.540092 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1ed4c3ab-4d8f-4bb6-ae8d-db1e43f190f3 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:07.595299 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:34:07.658493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1ed4c3ab-4d8f-4bb6-ae8d-db1e43f190f3 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:07.668255 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1ed4c3ab-4d8f-4bb6-ae8d-db1e43f190f3 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1614 microversion: 2.1 time: 0.161407 Jul 20 08:34:07.676013 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 452/908] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:07 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1614 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:07.853521 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e085f313-200b-4fec-87ff-ecdcf463a7d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:07.855743 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e085f313-200b-4fec-87ff-ecdcf463a7d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:07.875715 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e085f313-200b-4fec-87ff-ecdcf463a7d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:07.887514 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e085f313-200b-4fec-87ff-ecdcf463a7d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:07.890535 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e085f313-200b-4fec-87ff-ecdcf463a7d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:07.894072 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e085f313-200b-4fec-87ff-ecdcf463a7d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:07.931468 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d5bcb322-38e1-4155-b6df-6c67c4c9e1eb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:07.936642 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d5bcb322-38e1-4155-b6df-6c67c4c9e1eb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:07.996328 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d5bcb322-38e1-4155-b6df-6c67c4c9e1eb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:07.997684 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d5bcb322-38e1-4155-b6df-6c67c4c9e1eb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:08.002614 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d5bcb322-38e1-4155-b6df-6c67c4c9e1eb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:08.009188 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d5bcb322-38e1-4155-b6df-6c67c4c9e1eb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:08.307456 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d5bcb322-38e1-4155-b6df-6c67c4c9e1eb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:08.328600 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d5bcb322-38e1-4155-b6df-6c67c4c9e1eb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1225 microversion: 2.1 time: 0.405764 Jul 20 08:34:08.330371 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 453/909] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:07 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1225 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:08.376299 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a4a44eda-4f47-46b9-9161-884efb6138d6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:08.377210 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a4a44eda-4f47-46b9-9161-884efb6138d6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:08.395200 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a4a44eda-4f47-46b9-9161-884efb6138d6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:08.395923 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a4a44eda-4f47-46b9-9161-884efb6138d6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:08.396991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a4a44eda-4f47-46b9-9161-884efb6138d6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:08.397596 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a4a44eda-4f47-46b9-9161-884efb6138d6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:08.466167 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a4a44eda-4f47-46b9-9161-884efb6138d6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:08.468804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a4a44eda-4f47-46b9-9161-884efb6138d6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:08.470211 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.objects.instance [None req-a4a44eda-4f47-46b9-9161-884efb6138d6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lazy-loading 'fault' on Instance uuid bd05a594-404a-4d6e-ab1a-ee3aacb3970d {{(pid=117828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:34:08.574471 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e085f313-200b-4fec-87ff-ecdcf463a7d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:08.591556 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e085f313-200b-4fec-87ff-ecdcf463a7d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:08.598228 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e085f313-200b-4fec-87ff-ecdcf463a7d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:08.601773 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e085f313-200b-4fec-87ff-ecdcf463a7d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1725 microversion: 2.20 time: 0.753086 Jul 20 08:34:08.604532 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 457/910] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:34:07 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1725 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:34:08.614006 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a4a44eda-4f47-46b9-9161-884efb6138d6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:08.630021 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a4a44eda-4f47-46b9-9161-884efb6138d6 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 200 len: 1335 microversion: 2.1 time: 0.255007 Jul 20 08:34:08.631807 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 454/911] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:08 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 1335 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:08.706233 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f653e1b0-02a2-4611-8ad5-7eb79e2a64c0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:08.707450 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f653e1b0-02a2-4611-8ad5-7eb79e2a64c0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:08.717076 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f653e1b0-02a2-4611-8ad5-7eb79e2a64c0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:08.718573 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f653e1b0-02a2-4611-8ad5-7eb79e2a64c0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:08.720743 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f653e1b0-02a2-4611-8ad5-7eb79e2a64c0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:08.721857 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f653e1b0-02a2-4611-8ad5-7eb79e2a64c0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:08.793005 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f653e1b0-02a2-4611-8ad5-7eb79e2a64c0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:08.794368 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f653e1b0-02a2-4611-8ad5-7eb79e2a64c0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:08.794971 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.objects.instance [None req-f653e1b0-02a2-4611-8ad5-7eb79e2a64c0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lazy-loading 'fault' on Instance uuid 28eb9e1d-9ca5-43a1-8330-ae91249f609c {{(pid=117829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:34:08.834613 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-638feee9-f65b-498a-9f96-8eb654d28b12 req-1d2a1c82-58f6-4218-8bba-23a6ae71bd8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b295e0-508c-4cd5-b18f-3b808c0ff265", "name": "network-vif-unplugged", "status": "completed", "tag": "25187f6d-a614-4168-94dd-d0c397aaf6f3"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:08.869884 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-638feee9-f65b-498a-9f96-8eb654d28b12 req-1d2a1c82-58f6-4218-8bba-23a6ae71bd8e service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:08.870347 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-638feee9-f65b-498a-9f96-8eb654d28b12 req-1d2a1c82-58f6-4218-8bba-23a6ae71bd8e service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:08.943799 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-638feee9-f65b-498a-9f96-8eb654d28b12 req-1d2a1c82-58f6-4218-8bba-23a6ae71bd8e service nova] Creating event network-vif-unplugged:25187f6d-a614-4168-94dd-d0c397aaf6f3 for instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 on hv-cinder-82308 Jul 20 08:34:08.952132 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f653e1b0-02a2-4611-8ad5-7eb79e2a64c0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:08.957848 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-638feee9-f65b-498a-9f96-8eb654d28b12 req-1d2a1c82-58f6-4218-8bba-23a6ae71bd8e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137240 Jul 20 08:34:08.966973 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f653e1b0-02a2-4611-8ad5-7eb79e2a64c0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 200 len: 1331 microversion: 2.1 time: 0.265219 Jul 20 08:34:08.968637 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 455/912] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:34:08.971718 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 458/913] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:08 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 1331 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:09.341899 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-4768a9b0-4263-4e8f-83c5-0f748c959cdf req-d321e218-6847-4b3b-b4ee-3c801afa0682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28eb9e1d-9ca5-43a1-8330-ae91249f609c", "name": "network-vif-deleted", "tag": "70393be6-628d-4634-90f4-13212f783bcf"}, {"server_uuid": "15050cb9-f79e-4546-b875-1b4e338312fa", "name": "network-vif-deleted", "tag": "91e7ab01-3fe6-490c-8584-7db55fc13380"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:09.348422 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4d44ded9-9205-4539-a76d-4e45b96a453d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:09.349516 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4d44ded9-9205-4539-a76d-4e45b96a453d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:09.362831 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-4768a9b0-4263-4e8f-83c5-0f748c959cdf req-d321e218-6847-4b3b-b4ee-3c801afa0682 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:09.367925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-4768a9b0-4263-4e8f-83c5-0f748c959cdf req-d321e218-6847-4b3b-b4ee-3c801afa0682 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:09.378861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4d44ded9-9205-4539-a76d-4e45b96a453d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:09.384920 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4d44ded9-9205-4539-a76d-4e45b96a453d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:09.391010 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4d44ded9-9205-4539-a76d-4e45b96a453d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:09.392284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4d44ded9-9205-4539-a76d-4e45b96a453d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:09.409670 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-4768a9b0-4263-4e8f-83c5-0f748c959cdf req-d321e218-6847-4b3b-b4ee-3c801afa0682 service nova] Creating event network-vif-deleted:70393be6-628d-4634-90f4-13212f783bcf for instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c on hv-cinder-82308 Jul 20 08:34:09.412481 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-4768a9b0-4263-4e8f-83c5-0f748c959cdf req-d321e218-6847-4b3b-b4ee-3c801afa0682 service nova] Creating event network-vif-deleted:91e7ab01-3fe6-490c-8584-7db55fc13380 for instance 15050cb9-f79e-4546-b875-1b4e338312fa on hv-cinder-82308 Jul 20 08:34:09.433405 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-4768a9b0-4263-4e8f-83c5-0f748c959cdf req-d321e218-6847-4b3b-b4ee-3c801afa0682 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.098537 Jul 20 08:34:09.434759 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 456/914] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:34:09.494283 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4d44ded9-9205-4539-a76d-4e45b96a453d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:09.494658 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4d44ded9-9205-4539-a76d-4e45b96a453d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:09.500991 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.objects.instance [None req-4d44ded9-9205-4539-a76d-4e45b96a453d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lazy-loading 'fault' on Instance uuid 15050cb9-f79e-4546-b875-1b4e338312fa {{(pid=117829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:34:09.634268 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-25cb21a7-361c-48ae-87e3-0c44b7e3aa2f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:09.636447 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-25cb21a7-361c-48ae-87e3-0c44b7e3aa2f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:09.649158 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-25cb21a7-361c-48ae-87e3-0c44b7e3aa2f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:09.649455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4d44ded9-9205-4539-a76d-4e45b96a453d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:09.650337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-25cb21a7-361c-48ae-87e3-0c44b7e3aa2f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:09.651775 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-25cb21a7-361c-48ae-87e3-0c44b7e3aa2f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:09.655840 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-25cb21a7-361c-48ae-87e3-0c44b7e3aa2f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:09.662482 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4d44ded9-9205-4539-a76d-4e45b96a453d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 200 len: 1184 microversion: 2.1 time: 0.317914 Jul 20 08:34:09.663066 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 459/915] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:09 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 1184 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:09.677609 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-cfaf9662-37e7-42ef-9178-215cc99e899e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:09.678489 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-cfaf9662-37e7-42ef-9178-215cc99e899e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: bd05a594-404a-4d6e-ab1a-ee3aacb3970d] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:09.686119 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cfaf9662-37e7-42ef-9178-215cc99e899e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:09.687141 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cfaf9662-37e7-42ef-9178-215cc99e899e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:09.688460 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cfaf9662-37e7-42ef-9178-215cc99e899e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:09.689388 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cfaf9662-37e7-42ef-9178-215cc99e899e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:09.717251 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-cfaf9662-37e7-42ef-9178-215cc99e899e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] HTTP exception thrown: Instance bd05a594-404a-4d6e-ab1a-ee3aacb3970d could not be found. Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-cfaf9662-37e7-42ef-9178-215cc99e899e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Request method failure captured: Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d HTTP/1.1 Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17wLWBpeoKgfzdsi51_hIXGB8-8_ob4HBeMDTAoZXmbR9OTdLGoz8lraAbtA1VljznsqFm8mBeIJ78unFupJffa1Ph7RVWc5vPV_d-advUcTKgjrXktbtRaRuqi5OFUWnxKh_KRm9Y1lpwiWhLhvcvORrKWnqxeDw0PGarPIqsdcU-4 Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: b044b1d7d5474351bd94eb1c90882933 Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-762570368 Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:34:09.719278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:34:09.720658 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b044b1d7d5474351bd94eb1c90882933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b044b1d7d5474351bd94eb1c90882933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b044b1d7d5474351bd94eb1c90882933", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b044b1d7d5474351bd94eb1c90882933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:34:09.720658 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-ServerRescueNegativeTestJSON-762570368 Jul 20 08:34:09.720658 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: b044b1d7d5474351bd94eb1c90882933 Jul 20 08:34:09.720658 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-762570368 Jul 20 08:34:09.720658 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-ServerRescueNegativeTestJSON-762570368-project Jul 20 08:34:09.720658 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:34:09.720658 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:34:09.720658 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: bdc9e59d03334b72a8052e0f1112523f Jul 20 08:34:09.720658 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-ServerRescueNegativeTestJSON-762570368-project Jul 20 08:34:09.720658 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: > Jul 20 08:34:09.720658 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Instance bd05a594-404a-4d6e-ab1a-ee3aacb3970d could not be found. Jul 20 08:34:09.720658 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': 'bd05a594-404a-4d6e-ab1a-ee3aacb3970d'} Jul 20 08:34:09.721385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:34:09.721385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:09.721385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:34:09.721385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:34:09.721385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:34:09.721385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:34:09.721385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:34:09.721385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:34:09.721385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:34:09.721385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:34:09.721385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd05a594-404a-4d6e-ab1a-ee3aacb3970d could not be found. Jul 20 08:34:09.721385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:34:09.721385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:34:09.721385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:34:09.721385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:09.721385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:34:09.721385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:34:09.721385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:34:09.721385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:34:09.721385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:34:09.722552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:34:09.722552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:34:09.722552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:34:09.722552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:34:09.722552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:34:09.722552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:34:09.722552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:34:09.722552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd05a594-404a-4d6e-ab1a-ee3aacb3970d could not be found. Jul 20 08:34:09.722552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:34:09.722552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:34:09.722552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:34:09.722552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:09.722552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:34:09.722552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:34:09.722552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:34:09.722552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:34:09.722552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd05a594-404a-4d6e-ab1a-ee3aacb3970d could not be found. Jul 20 08:34:09.722552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:34:09.736990 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-cfaf9662-37e7-42ef-9178-215cc99e899e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Returning 404 to user: Instance bd05a594-404a-4d6e-ab1a-ee3aacb3970d could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:34:09.738074 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-cfaf9662-37e7-42ef-9178-215cc99e899e tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d" status: 404 len: 111 microversion: 2.1 time: 0.064338 Jul 20 08:34:09.738924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 460/916] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:09 2022] GET /compute/v2.1/servers/bd05a594-404a-4d6e-ab1a-ee3aacb3970d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:34:09.749304 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6ad6c702-9271-4ff6-ac79-9ba148052dfe tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '.version_select at 0x7fe399d82310>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:09.782356 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6ad6c702-9271-4ff6-ac79-9ba148052dfe tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1257488237" status: 202 len: 0 microversion: 2.1 time: 0.038558 Jul 20 08:34:09.783335 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 461/917] 10.222.0.64 () {58 vars in 1220 bytes} [Wed Jul 20 08:34:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1257488237 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 08:34:09.826720 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-25cb21a7-361c-48ae-87e3-0c44b7e3aa2f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:09.846189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-25cb21a7-361c-48ae-87e3-0c44b7e3aa2f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:09.852184 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-25cb21a7-361c-48ae-87e3-0c44b7e3aa2f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:09.856889 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-25cb21a7-361c-48ae-87e3-0c44b7e3aa2f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1657 microversion: 2.20 time: 0.233689 Jul 20 08:34:09.859607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 457/918] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:34:09 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1657 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:34:09.992205 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c1666d75-ad15-4b46-a96d-4f734d369b0e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:09.993103 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c1666d75-ad15-4b46-a96d-4f734d369b0e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:10.006120 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c1666d75-ad15-4b46-a96d-4f734d369b0e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:10.009459 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c1666d75-ad15-4b46-a96d-4f734d369b0e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:10.010613 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c1666d75-ad15-4b46-a96d-4f734d369b0e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:10.018610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c1666d75-ad15-4b46-a96d-4f734d369b0e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:10.066397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-c1666d75-ad15-4b46-a96d-4f734d369b0e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] HTTP exception thrown: Instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c could not be found. Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c1666d75-ad15-4b46-a96d-4f734d369b0e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Request method failure captured: Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c HTTP/1.1 Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17wixdWG9rc5IFR0aB2pk_ZbXSzHzAQw9OV7xc6ffVi-gC9dtYrya3ESysbvKCfhbC_hvUIb5xnU9fWVg9utseHpLd4EE5IxzuhHoy9DAbH7v7TBBmqEfRBrYIOvZrsS5CsvlsB_ARu1p91yjGC4MVw6_W2whdtfwL_HLJU3zguHAXQ Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:34:10.084809 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:34:10.086434 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60ee8039b1f4461c996165d5801b91f1", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:34:10.086434 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:34:10.086434 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:34:10.086434 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:34:10.086434 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:34:10.086434 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:34:10.086434 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:34:10.086434 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: e6c2070c6d2a450c887b8ca6b97c4b38 Jul 20 08:34:10.086434 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:34:10.086434 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: > Jul 20 08:34:10.086434 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c could not be found. Jul 20 08:34:10.086434 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': '28eb9e1d-9ca5-43a1-8330-ae91249f609c'} Jul 20 08:34:10.087361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:34:10.087361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:10.087361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:34:10.087361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:34:10.087361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:34:10.087361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:34:10.087361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:34:10.087361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:34:10.087361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:34:10.087361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:34:10.087361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c could not be found. Jul 20 08:34:10.087361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:34:10.087361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:34:10.087361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:34:10.087361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:10.087361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:34:10.087361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:34:10.087361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:34:10.087361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:34:10.087361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:34:10.088851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:34:10.088851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:34:10.088851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:34:10.088851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:34:10.088851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:34:10.088851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:34:10.088851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:34:10.088851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c could not be found. Jul 20 08:34:10.088851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:34:10.088851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:34:10.088851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:34:10.088851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:10.088851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:34:10.088851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:34:10.088851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:34:10.088851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:34:10.088851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c could not be found. Jul 20 08:34:10.088851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:34:10.090055 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c1666d75-ad15-4b46-a96d-4f734d369b0e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Returning 404 to user: Instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:34:10.090055 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c1666d75-ad15-4b46-a96d-4f734d369b0e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 404 len: 111 microversion: 2.1 time: 0.100530 Jul 20 08:34:10.094048 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 462/919] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:09 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 08:34:10.110948 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-747900b2-49ff-4f0f-b705-d90596195b55 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '.version_select at 0x7fe39946b8b0>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:10.191204 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-747900b2-49ff-4f0f-b705-d90596195b55 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1364603889" status: 202 len: 0 microversion: 2.1 time: 0.094927 Jul 20 08:34:10.203871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 458/920] 10.222.0.64 () {58 vars in 1220 bytes} [Wed Jul 20 08:34:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1364603889 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:34:10.680698 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-1aca1f16-8c5b-4f4e-9791-0becf3f16c5c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:10.681322 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-1aca1f16-8c5b-4f4e-9791-0becf3f16c5c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:10.705830 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1aca1f16-8c5b-4f4e-9791-0becf3f16c5c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:10.706249 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1aca1f16-8c5b-4f4e-9791-0becf3f16c5c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:10.719274 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1aca1f16-8c5b-4f4e-9791-0becf3f16c5c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:10.719737 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1aca1f16-8c5b-4f4e-9791-0becf3f16c5c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:10.791324 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-1aca1f16-8c5b-4f4e-9791-0becf3f16c5c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] HTTP exception thrown: Instance 15050cb9-f79e-4546-b875-1b4e338312fa could not be found. Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-1aca1f16-8c5b-4f4e-9791-0becf3f16c5c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Request method failure captured: Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa HTTP/1.1 Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17z4iiKUecsaa6PUNv71kuWWKnBtrgY4k1MibVftI57Wx_w7GteQnOSFDduat6f1v1LHe_RlY3GnBRpk9VUUSyKzAXBS8iql0T3A7Bt39o_xkfdsgRdTBSqpaCyj5lurRI52hdtkLyQ8hWvO6rOg_1wZx6D8Z1n0QS4E_AQKv0kW8Oc Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: fcfc8ebb18c54de29556d0b93593d676 Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-TestVolumeBootPattern-985957797 Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:34:10.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:34:10.795076 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fcfc8ebb18c54de29556d0b93593d676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fcfc8ebb18c54de29556d0b93593d676"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fcfc8ebb18c54de29556d0b93593d676", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fcfc8ebb18c54de29556d0b93593d676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:34:10.795076 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-TestVolumeBootPattern-985957797 Jul 20 08:34:10.795076 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: fcfc8ebb18c54de29556d0b93593d676 Jul 20 08:34:10.795076 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-TestVolumeBootPattern-985957797 Jul 20 08:34:10.795076 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-TestVolumeBootPattern-985957797-project Jul 20 08:34:10.795076 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:34:10.795076 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:34:10.795076 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: 19024dea6ca94745b38158beb08f29fc Jul 20 08:34:10.795076 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-TestVolumeBootPattern-985957797-project Jul 20 08:34:10.795076 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: > Jul 20 08:34:10.795076 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Instance 15050cb9-f79e-4546-b875-1b4e338312fa could not be found. Jul 20 08:34:10.795076 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': '15050cb9-f79e-4546-b875-1b4e338312fa'} Jul 20 08:34:10.796504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:34:10.796504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:10.796504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:34:10.796504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:34:10.796504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:34:10.796504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:34:10.796504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:34:10.796504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:34:10.796504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:34:10.796504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:34:10.796504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15050cb9-f79e-4546-b875-1b4e338312fa could not be found. Jul 20 08:34:10.796504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:34:10.796504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:34:10.796504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:34:10.796504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:10.796504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:34:10.796504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:34:10.796504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:34:10.796504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:34:10.796504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:34:10.798208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:34:10.798208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:34:10.798208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:34:10.798208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:34:10.798208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:34:10.798208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:34:10.798208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:34:10.798208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15050cb9-f79e-4546-b875-1b4e338312fa could not be found. Jul 20 08:34:10.798208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:34:10.798208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:34:10.798208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:34:10.798208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:10.798208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:34:10.798208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:34:10.798208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:34:10.798208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:34:10.798208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15050cb9-f79e-4546-b875-1b4e338312fa could not be found. Jul 20 08:34:10.798208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:34:10.803560 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-1aca1f16-8c5b-4f4e-9791-0becf3f16c5c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Returning 404 to user: Instance 15050cb9-f79e-4546-b875-1b4e338312fa could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:34:10.808549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-1aca1f16-8c5b-4f4e-9791-0becf3f16c5c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 404 len: 111 microversion: 2.1 time: 0.131685 Jul 20 08:34:10.811615 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 463/921] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:10 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:34:10.881389 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d5dd40a7-6940-4958-b062-7717e25deb2a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:10.882056 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d5dd40a7-6940-4958-b062-7717e25deb2a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:10.897745 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d5dd40a7-6940-4958-b062-7717e25deb2a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:10.898201 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d5dd40a7-6940-4958-b062-7717e25deb2a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:10.899039 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d5dd40a7-6940-4958-b062-7717e25deb2a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:10.899481 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d5dd40a7-6940-4958-b062-7717e25deb2a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:10.944620 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6ed99b35-02c5-48cf-89ee-cd05121005e8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2043693320", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-626472504", "security_groups": [{"name": "tempest-secgroup-smoke-1425617466"}], "block_device_mapping_v2": [{"uuid": "cbaa8b0b-508e-4620-9ee7-4c694038cad5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "348269a8-7968-40a5-99e7-854f19c8d583"}]}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:11.027769 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d5dd40a7-6940-4958-b062-7717e25deb2a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:11.031600 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d5dd40a7-6940-4958-b062-7717e25deb2a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:11.035384 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.objects.instance [None req-d5dd40a7-6940-4958-b062-7717e25deb2a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lazy-loading 'fault' on Instance uuid 21b295e0-508c-4cd5-b18f-3b808c0ff265 {{(pid=117828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:34:11.209922 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d5dd40a7-6940-4958-b062-7717e25deb2a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:11.223693 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d5dd40a7-6940-4958-b062-7717e25deb2a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:11.230471 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d5dd40a7-6940-4958-b062-7717e25deb2a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:11.234421 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d5dd40a7-6940-4958-b062-7717e25deb2a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 200 len: 1371 microversion: 2.20 time: 0.357968 Jul 20 08:34:11.246065 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 459/922] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:34:10 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 1371 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:34:11.386496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.network.neutron [None req-6ed99b35-02c5-48cf-89ee-cd05121005e8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] validate_networks() for [('348269a8-7968-40a5-99e7-854f19c8d583', None, None, None, None, None)] {{(pid=117829) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:34:11.614434 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-2bd337ed-d14c-4459-ac3f-d416e4a286b1 req-a92c9b0b-8c6f-4eac-bf8f-620ab1f10b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21b295e0-508c-4cd5-b18f-3b808c0ff265", "name": "network-vif-deleted", "tag": "25187f6d-a614-4168-94dd-d0c397aaf6f3"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:11.630160 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-2bd337ed-d14c-4459-ac3f-d416e4a286b1 req-a92c9b0b-8c6f-4eac-bf8f-620ab1f10b67 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:11.632519 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-2bd337ed-d14c-4459-ac3f-d416e4a286b1 req-a92c9b0b-8c6f-4eac-bf8f-620ab1f10b67 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:11.660940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-2bd337ed-d14c-4459-ac3f-d416e4a286b1 req-a92c9b0b-8c6f-4eac-bf8f-620ab1f10b67 service nova] Creating event network-vif-deleted:25187f6d-a614-4168-94dd-d0c397aaf6f3 for instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 on hv-cinder-82308 Jul 20 08:34:11.667491 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-2bd337ed-d14c-4459-ac3f-d416e4a286b1 req-a92c9b0b-8c6f-4eac-bf8f-620ab1f10b67 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056414 Jul 20 08:34:11.669537 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 460/923] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:34:11.806153 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1ebd9a78-81c8-4330-b9ff-03245e4381ac tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:11.806819 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1ebd9a78-81c8-4330-b9ff-03245e4381ac tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:11.814723 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1ebd9a78-81c8-4330-b9ff-03245e4381ac tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:11.815337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1ebd9a78-81c8-4330-b9ff-03245e4381ac tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:11.816304 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1ebd9a78-81c8-4330-b9ff-03245e4381ac tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:11.816734 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1ebd9a78-81c8-4330-b9ff-03245e4381ac tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:11.924555 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.objects.instance [None req-1ebd9a78-81c8-4330-b9ff-03245e4381ac tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lazy-loading 'services' on Instance uuid 659d1d17-9163-4971-9ba1-40f3f20d2650 {{(pid=117828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:34:11.964116 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-6ed99b35-02c5-48cf-89ee-cd05121005e8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Flavor limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:34:11.964644 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-6ed99b35-02c5-48cf-89ee-cd05121005e8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Image limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:34:11.965123 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-6ed99b35-02c5-48cf-89ee-cd05121005e8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Flavor pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:34:11.966350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-6ed99b35-02c5-48cf-89ee-cd05121005e8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Image pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:34:11.967524 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-6ed99b35-02c5-48cf-89ee-cd05121005e8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:34:11.986866 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6ed99b35-02c5-48cf-89ee-cd05121005e8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:11.987476 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6ed99b35-02c5-48cf-89ee-cd05121005e8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:11.988301 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6ed99b35-02c5-48cf-89ee-cd05121005e8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:11.988726 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6ed99b35-02c5-48cf-89ee-cd05121005e8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:12.011851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-6ed99b35-02c5-48cf-89ee-cd05121005e8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Getting quotas for project fcfc8ebb18c54de29556d0b93593d676. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:34:12.018756 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-6ed99b35-02c5-48cf-89ee-cd05121005e8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Getting quotas for user 19024dea6ca94745b38158beb08f29fc and project fcfc8ebb18c54de29556d0b93593d676. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:34:12.025315 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1ebd9a78-81c8-4330-b9ff-03245e4381ac tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "DELETE /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650/os-volume_attachments/39f23770-1802-4711-a880-97cedc3327ba" status: 202 len: 0 microversion: 2.1 time: 0.224448 Jul 20 08:34:12.026877 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 461/924] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Jul 20 08:34:11 2022] DELETE /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650/os-volume_attachments/39f23770-1802-4711-a880-97cedc3327ba => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 08:34:12.041248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0f35271c-2c69-4285-8db9-eff729044696 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:12.044398 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0f35271c-2c69-4285-8db9-eff729044696 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:12.057426 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0f35271c-2c69-4285-8db9-eff729044696 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:12.058097 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0f35271c-2c69-4285-8db9-eff729044696 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:12.059783 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0f35271c-2c69-4285-8db9-eff729044696 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:12.060562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0f35271c-2c69-4285-8db9-eff729044696 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:12.103730 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0f35271c-2c69-4285-8db9-eff729044696 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069659 Jul 20 08:34:12.104660 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 462/925] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Jul 20 08:34:12 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:34:12.120008 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6ed99b35-02c5-48cf-89ee-cd05121005e8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Going to run 1 instances... {{(pid=117829) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:34:12.123054 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6ed99b35-02c5-48cf-89ee-cd05121005e8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cbaa8b0b-508e-4620-9ee7-4c694038cad5',volume_size=None,volume_type=None)] {{(pid=117829) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:34:12.168232 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 08:34:12.168232 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Wed Jul 20 08:34:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.64) !!! Jul 20 08:34:12.254493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7eb50742-2ac2-4bea-8151-2d186f873b16 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:12.255345 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-7eb50742-2ac2-4bea-8151-2d186f873b16 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:12.261923 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7eb50742-2ac2-4bea-8151-2d186f873b16 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:12.263893 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7eb50742-2ac2-4bea-8151-2d186f873b16 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:12.265490 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7eb50742-2ac2-4bea-8151-2d186f873b16 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:12.265810 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7eb50742-2ac2-4bea-8151-2d186f873b16 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:12.284302 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-7eb50742-2ac2-4bea-8151-2d186f873b16 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] HTTP exception thrown: Instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 could not be found. Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7eb50742-2ac2-4bea-8151-2d186f873b16 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Request method failure captured: Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 HTTP/1.1 Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wMdqJgraEhg-CmqjQbcQK9jOfe_AMqFkk3FxIRd2RzO6SlDEPybLrXL7xLVZuDbuSsCxTxhq6XF-I5nVnfRSrncR8_aNu5meRhkEpX7LSQz6rznOlgkFbfMnn-Q8j2lgnkjO5VV1oQNYYNR5nZCsv74kqMwsDRwL9aCRxe8DUC1wQ Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: 80faf6362e244bb992ffb6058ceeefda Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2013247676 Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:34:12.286022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:34:12.290077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/80faf6362e244bb992ffb6058ceeefda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/80faf6362e244bb992ffb6058ceeefda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_80faf6362e244bb992ffb6058ceeefda", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/80faf6362e244bb992ffb6058ceeefda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:34:12.290077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2013247676 Jul 20 08:34:12.290077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: 80faf6362e244bb992ffb6058ceeefda Jul 20 08:34:12.290077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2013247676 Jul 20 08:34:12.290077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-AttachVolumeShelveTestJSON-2013247676-project Jul 20 08:34:12.290077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:34:12.290077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:34:12.290077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: fb5f0f7e59dd4c548a6ea72bb25f1ebb Jul 20 08:34:12.290077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2013247676-project Jul 20 08:34:12.290077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:34:12.290077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 could not be found. Jul 20 08:34:12.290077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': '21b295e0-508c-4cd5-b18f-3b808c0ff265'} Jul 20 08:34:12.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:34:12.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:12.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:34:12.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:34:12.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:34:12.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:34:12.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:34:12.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:34:12.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:34:12.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:34:12.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 could not be found. Jul 20 08:34:12.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:34:12.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:34:12.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:34:12.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:12.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:34:12.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:34:12.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:34:12.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:34:12.291950 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:34:12.295516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:34:12.295516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:34:12.295516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:34:12.295516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:34:12.295516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:34:12.295516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:34:12.295516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:34:12.295516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 could not be found. Jul 20 08:34:12.295516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:34:12.295516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:34:12.295516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:34:12.295516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:12.295516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:34:12.295516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:34:12.295516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:34:12.295516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:34:12.295516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 could not be found. Jul 20 08:34:12.295516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:34:12.297290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7eb50742-2ac2-4bea-8151-2d186f873b16 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Returning 404 to user: Instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:34:12.297290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-7eb50742-2ac2-4bea-8151-2d186f873b16 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 404 len: 111 microversion: 2.20 time: 0.037411 Jul 20 08:34:12.297290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 463/926] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:34:12 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 08:34:12.298281 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-4eb1aa84-b5a8-4a15-989f-3bab29e7d071 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '.version_select at 0x7fe39955a940>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:12.326840 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-4eb1aa84-b5a8-4a15-989f-3bab29e7d071 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-972139346" status: 204 len: 0 microversion: 2.20 time: 0.033989 Jul 20 08:34:12.327895 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 464/927] 10.222.0.64 () {60 vars in 1258 bytes} [Wed Jul 20 08:34:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-972139346 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 08:34:12.341825 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6ed99b35-02c5-48cf-89ee-cd05121005e8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.402059 Jul 20 08:34:12.343280 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 464/928] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Jul 20 08:34:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 08:34:12.355026 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-21aaa899-0590-449f-bed1-dfc6d1dd284e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:12.356919 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-21aaa899-0590-449f-bed1-dfc6d1dd284e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:12.360286 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:34:12.437067 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-21aaa899-0590-449f-bed1-dfc6d1dd284e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:12.446980 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-21aaa899-0590-449f-bed1-dfc6d1dd284e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1094 microversion: 2.1 time: 0.097502 Jul 20 08:34:12.448019 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 465/929] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:12 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1094 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:13.124606 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8c35ebaa-295a-4add-95a0-7e75b42b3320 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:13.127089 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8c35ebaa-295a-4add-95a0-7e75b42b3320 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:13.138899 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8c35ebaa-295a-4add-95a0-7e75b42b3320 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:13.140214 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8c35ebaa-295a-4add-95a0-7e75b42b3320 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:13.141709 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8c35ebaa-295a-4add-95a0-7e75b42b3320 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:13.142219 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8c35ebaa-295a-4add-95a0-7e75b42b3320 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:13.180488 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8c35ebaa-295a-4add-95a0-7e75b42b3320 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063744 Jul 20 08:34:13.181077 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 465/930] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Jul 20 08:34:13 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 08:34:13.229706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-11b5ea1e-0f94-49a6-9553-28691480491b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Action: 'create', calling method: .version_select at 0x7fe39947d310>, body: {"keypair": {"name": "tempest-keypair-1771475061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNbOs9y9d9Cj6ZY3iP+ia5Q8BfGwaXbDdHmc0D142tWeQnc5kyMN+KVlgll0SfWk4iU0uhOhyL5l9GjGW5ZIUQAqx7WZoIG9fuzhNIuKiVifTgF1pxPTg6Qot+ONEL1dg=="}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:13.249835 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-11b5ea1e-0f94-49a6-9553-28691480491b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Getting quotas for project 80faf6362e244bb992ffb6058ceeefda. Resources: {'key_pairs'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:34:13.255664 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-11b5ea1e-0f94-49a6-9553-28691480491b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Getting quotas for user fb5f0f7e59dd4c548a6ea72bb25f1ebb and project 80faf6362e244bb992ffb6058ceeefda. Resources: {'key_pairs'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:34:13.269306 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-37d1a71a-6f22-453b-8c5c-4d73e7eb596c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:13.269770 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-37d1a71a-6f22-453b-8c5c-4d73e7eb596c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:13.277467 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-37d1a71a-6f22-453b-8c5c-4d73e7eb596c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:13.278639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-37d1a71a-6f22-453b-8c5c-4d73e7eb596c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:13.280210 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-37d1a71a-6f22-453b-8c5c-4d73e7eb596c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:13.280652 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-37d1a71a-6f22-453b-8c5c-4d73e7eb596c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:13.292604 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-11b5ea1e-0f94-49a6-9553-28691480491b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.067436 Jul 20 08:34:13.293569 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 466/931] 10.222.0.64 () {62 vars in 1199 bytes} [Wed Jul 20 08:34:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 20 08:34:13.309272 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-37d1a71a-6f22-453b-8c5c-4d73e7eb596c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Going to try to terminate instance {{(pid=117829) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:34:13.390654 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:34:13.443938 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-37d1a71a-6f22-453b-8c5c-4d73e7eb596c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "DELETE /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 204 len: 0 microversion: 2.1 time: 0.178111 Jul 20 08:34:13.445084 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 466/932] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:34:13 2022] DELETE /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:34:13.454481 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-704fd4cf-9c53-4833-a566-cb8bb0a77416 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:13.455327 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-704fd4cf-9c53-4833-a566-cb8bb0a77416 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:13.465217 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-704fd4cf-9c53-4833-a566-cb8bb0a77416 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:13.466476 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-704fd4cf-9c53-4833-a566-cb8bb0a77416 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:13.467290 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-bee8d9bb-cb74-4196-8cf6-85710b75b7b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:13.467686 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-704fd4cf-9c53-4833-a566-cb8bb0a77416 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:13.468006 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-bee8d9bb-cb74-4196-8cf6-85710b75b7b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:13.468814 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-704fd4cf-9c53-4833-a566-cb8bb0a77416 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:13.585906 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-bee8d9bb-cb74-4196-8cf6-85710b75b7b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:13.597911 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-bee8d9bb-cb74-4196-8cf6-85710b75b7b8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1094 microversion: 2.1 time: 0.135958 Jul 20 08:34:13.598623 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 467/933] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:13 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1094 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:13.733995 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-704fd4cf-9c53-4833-a566-cb8bb0a77416 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:13.746698 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-704fd4cf-9c53-4833-a566-cb8bb0a77416 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1678 microversion: 2.1 time: 0.296750 Jul 20 08:34:13.747782 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 467/934] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:13 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1678 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:13.951892 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-250fe8b8-29fc-4239-b566-afc1fb4bfd77 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:13.952818 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-250fe8b8-29fc-4239-b566-afc1fb4bfd77 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:13.964824 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-250fe8b8-29fc-4239-b566-afc1fb4bfd77 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:13.966110 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-250fe8b8-29fc-4239-b566-afc1fb4bfd77 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:13.967456 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-250fe8b8-29fc-4239-b566-afc1fb4bfd77 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:13.968030 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-250fe8b8-29fc-4239-b566-afc1fb4bfd77 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:14.002086 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-250fe8b8-29fc-4239-b566-afc1fb4bfd77 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Going to try to terminate instance {{(pid=117829) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:34:14.114567 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-250fe8b8-29fc-4239-b566-afc1fb4bfd77 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 204 len: 0 microversion: 2.1 time: 0.169553 Jul 20 08:34:14.115189 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 468/935] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:34:13 2022] DELETE /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:34:14.124766 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0d323d1d-bddb-41cc-85e6-d86ad6b10dfa tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:14.125531 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0d323d1d-bddb-41cc-85e6-d86ad6b10dfa tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:14.135546 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0d323d1d-bddb-41cc-85e6-d86ad6b10dfa tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:14.136558 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0d323d1d-bddb-41cc-85e6-d86ad6b10dfa tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:14.137731 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0d323d1d-bddb-41cc-85e6-d86ad6b10dfa tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:14.138347 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0d323d1d-bddb-41cc-85e6-d86ad6b10dfa tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:14.462213 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-0d323d1d-bddb-41cc-85e6-d86ad6b10dfa tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:14.470435 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0d323d1d-bddb-41cc-85e6-d86ad6b10dfa tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1509 microversion: 2.1 time: 0.350932 Jul 20 08:34:14.471043 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 468/936] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:14 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1509 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:14.624194 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9e0feb18-1c7c-4d61-bf90-1b0f88d3c2e4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:14.624899 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9e0feb18-1c7c-4d61-bf90-1b0f88d3c2e4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:14.718151 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9e0feb18-1c7c-4d61-bf90-1b0f88d3c2e4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:14.727139 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9e0feb18-1c7c-4d61-bf90-1b0f88d3c2e4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1094 microversion: 2.1 time: 0.108185 Jul 20 08:34:14.739515 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 469/937] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:14 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1094 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:14.767502 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-57712b57-8b6a-4a0b-99a0-86fc63d669a7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:14.768508 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-57712b57-8b6a-4a0b-99a0-86fc63d669a7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:14.776113 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-57712b57-8b6a-4a0b-99a0-86fc63d669a7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:14.776944 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-57712b57-8b6a-4a0b-99a0-86fc63d669a7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:14.778215 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-57712b57-8b6a-4a0b-99a0-86fc63d669a7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:14.778823 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-57712b57-8b6a-4a0b-99a0-86fc63d669a7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:14.998687 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-57712b57-8b6a-4a0b-99a0-86fc63d669a7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:15.006660 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-57712b57-8b6a-4a0b-99a0-86fc63d669a7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1678 microversion: 2.1 time: 0.244024 Jul 20 08:34:15.007246 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 469/938] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:14 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1678 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:15.148366 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-be2c07b2-c4a1-46cd-b410-841bc8d2c92e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1974655711", "imageRef": "5d6b971e-8afe-4e4a-b054-20cd61970c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "493487e7-e371-48c4-94a1-b290ee37dc8e"}], "security_groups": [{"name": "tempest-securitygroup--292681808"}], "key_name": "tempest-keypair-1771475061", "user_data": "}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:15.425644 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.network.neutron [None req-be2c07b2-c4a1-46cd-b410-841bc8d2c92e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] validate_networks() for [('493487e7-e371-48c4-94a1-b290ee37dc8e', None, None, None, None, None)] {{(pid=117829) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:34:15.489654 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8f5074a2-00a8-4574-b7b7-50993ead73e7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:15.490313 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8f5074a2-00a8-4574-b7b7-50993ead73e7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:15.497851 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8f5074a2-00a8-4574-b7b7-50993ead73e7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:15.498405 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8f5074a2-00a8-4574-b7b7-50993ead73e7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:15.499271 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8f5074a2-00a8-4574-b7b7-50993ead73e7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:15.499770 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8f5074a2-00a8-4574-b7b7-50993ead73e7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:15.638993 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-8f5074a2-00a8-4574-b7b7-50993ead73e7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:15.647278 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8f5074a2-00a8-4574-b7b7-50993ead73e7 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1509 microversion: 2.1 time: 0.161496 Jul 20 08:34:15.647937 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 470/939] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:15 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:15.756199 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-34ed3411-d0bf-49d1-9f9b-48149cae89df tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:15.757126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-34ed3411-d0bf-49d1-9f9b-48149cae89df tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:15.764196 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-34ed3411-d0bf-49d1-9f9b-48149cae89df tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:15.764912 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-34ed3411-d0bf-49d1-9f9b-48149cae89df tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:15.765881 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-34ed3411-d0bf-49d1-9f9b-48149cae89df tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:15.766246 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-34ed3411-d0bf-49d1-9f9b-48149cae89df tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:15.839072 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-34ed3411-d0bf-49d1-9f9b-48149cae89df tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:15.848789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-34ed3411-d0bf-49d1-9f9b-48149cae89df tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1192 microversion: 2.1 time: 0.096575 Jul 20 08:34:15.849382 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 471/940] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:15 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1192 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:16.025254 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-aa7be499-2f93-4856-ac9c-f90561c838e2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:16.025857 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-aa7be499-2f93-4856-ac9c-f90561c838e2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:16.032167 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aa7be499-2f93-4856-ac9c-f90561c838e2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:16.032614 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aa7be499-2f93-4856-ac9c-f90561c838e2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:16.033387 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aa7be499-2f93-4856-ac9c-f90561c838e2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:16.033944 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aa7be499-2f93-4856-ac9c-f90561c838e2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:16.173363 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-aa7be499-2f93-4856-ac9c-f90561c838e2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:16.181756 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-aa7be499-2f93-4856-ac9c-f90561c838e2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1678 microversion: 2.1 time: 0.160301 Jul 20 08:34:16.182335 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 472/941] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:16 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:16.354569 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:34:16.665355 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b2cb8b2b-907e-479c-8646-781e5833e0ce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:16.666962 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b2cb8b2b-907e-479c-8646-781e5833e0ce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:16.675136 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b2cb8b2b-907e-479c-8646-781e5833e0ce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:16.675598 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b2cb8b2b-907e-479c-8646-781e5833e0ce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:16.676421 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b2cb8b2b-907e-479c-8646-781e5833e0ce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:16.676861 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b2cb8b2b-907e-479c-8646-781e5833e0ce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:16.834057 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b2cb8b2b-907e-479c-8646-781e5833e0ce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:16.843336 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b2cb8b2b-907e-479c-8646-781e5833e0ce tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 200 len: 1509 microversion: 2.1 time: 0.182553 Jul 20 08:34:16.843920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 473/942] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:16 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 1509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:16.867074 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b7aae395-c32b-4d0a-a323-9d7f0f3d2e30 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:16.867672 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b7aae395-c32b-4d0a-a323-9d7f0f3d2e30 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:16.875392 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b7aae395-c32b-4d0a-a323-9d7f0f3d2e30 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:16.876090 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b7aae395-c32b-4d0a-a323-9d7f0f3d2e30 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:16.877070 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b7aae395-c32b-4d0a-a323-9d7f0f3d2e30 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:16.877531 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b7aae395-c32b-4d0a-a323-9d7f0f3d2e30 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:16.896804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:34:16.951596 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b7aae395-c32b-4d0a-a323-9d7f0f3d2e30 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:16.963782 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b7aae395-c32b-4d0a-a323-9d7f0f3d2e30 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1198 microversion: 2.1 time: 0.100756 Jul 20 08:34:16.974855 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 474/943] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:16 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1198 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:17.111028 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-be2c07b2-c4a1-46cd-b410-841bc8d2c92e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Flavor limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:34:17.111770 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-be2c07b2-c4a1-46cd-b410-841bc8d2c92e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Image limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:34:17.112294 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-be2c07b2-c4a1-46cd-b410-841bc8d2c92e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Flavor pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:34:17.112776 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-be2c07b2-c4a1-46cd-b410-841bc8d2c92e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Image pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:34:17.113263 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-be2c07b2-c4a1-46cd-b410-841bc8d2c92e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:34:17.123662 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-be2c07b2-c4a1-46cd-b410-841bc8d2c92e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:17.124201 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-be2c07b2-c4a1-46cd-b410-841bc8d2c92e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:17.125103 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-be2c07b2-c4a1-46cd-b410-841bc8d2c92e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:17.125633 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-be2c07b2-c4a1-46cd-b410-841bc8d2c92e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:17.145085 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-be2c07b2-c4a1-46cd-b410-841bc8d2c92e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Getting quotas for project 80faf6362e244bb992ffb6058ceeefda. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:34:17.149383 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-be2c07b2-c4a1-46cd-b410-841bc8d2c92e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Getting quotas for user fb5f0f7e59dd4c548a6ea72bb25f1ebb and project 80faf6362e244bb992ffb6058ceeefda. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:34:17.164642 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-be2c07b2-c4a1-46cd-b410-841bc8d2c92e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Going to run 1 instances... {{(pid=117829) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:34:17.165583 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-19cc8514-6b05-4812-9aef-47dc64615f49 req-edd27b8b-ac7b-4e79-9953-684ce397b888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a", "name": "network-vif-deleted", "tag": "7f795798-1661-4ba0-bf5a-641687efe8e3"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:17.168134 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-be2c07b2-c4a1-46cd-b410-841bc8d2c92e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d6b971e-8afe-4e4a-b054-20cd61970c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117829) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:34:17.177527 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-19cc8514-6b05-4812-9aef-47dc64615f49 req-edd27b8b-ac7b-4e79-9953-684ce397b888 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:17.179805 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-19cc8514-6b05-4812-9aef-47dc64615f49 req-edd27b8b-ac7b-4e79-9953-684ce397b888 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:17.198364 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-19cc8514-6b05-4812-9aef-47dc64615f49 req-edd27b8b-ac7b-4e79-9953-684ce397b888 service nova] Creating event network-vif-deleted:7f795798-1661-4ba0-bf5a-641687efe8e3 for instance ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a on hv-cinder-82308 Jul 20 08:34:17.208877 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-19cc8514-6b05-4812-9aef-47dc64615f49 req-edd27b8b-ac7b-4e79-9953-684ce397b888 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049244 Jul 20 08:34:17.210115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 475/944] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:34:17.218879 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-82f2f907-c07b-4a4a-9204-5998f8a342d0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:17.220489 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-82f2f907-c07b-4a4a-9204-5998f8a342d0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:17.228468 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-82f2f907-c07b-4a4a-9204-5998f8a342d0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:17.229179 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-82f2f907-c07b-4a4a-9204-5998f8a342d0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:17.231544 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-82f2f907-c07b-4a4a-9204-5998f8a342d0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:17.232190 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-82f2f907-c07b-4a4a-9204-5998f8a342d0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:17.246418 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-be2c07b2-c4a1-46cd-b410-841bc8d2c92e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.102472 Jul 20 08:34:17.253921 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 470/945] 10.222.0.64 () {62 vars in 1187 bytes} [Wed Jul 20 08:34:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 2111 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 08:34:17.269475 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8b1aaec5-5444-403d-96bf-4a9e3dce7ef4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:17.271967 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8b1aaec5-5444-403d-96bf-4a9e3dce7ef4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:17.352334 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-82f2f907-c07b-4a4a-9204-5998f8a342d0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:17.362853 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-82f2f907-c07b-4a4a-9204-5998f8a342d0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1611 microversion: 2.1 time: 0.150958 Jul 20 08:34:17.363368 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 476/946] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:17 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1611 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:17.401317 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8b1aaec5-5444-403d-96bf-4a9e3dce7ef4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:17.432907 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8b1aaec5-5444-403d-96bf-4a9e3dce7ef4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:17.438983 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8b1aaec5-5444-403d-96bf-4a9e3dce7ef4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:17.440840 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8b1aaec5-5444-403d-96bf-4a9e3dce7ef4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1282 microversion: 2.20 time: 0.181971 Jul 20 08:34:17.441971 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 471/947] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:34:17 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1282 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:34:17.862288 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7538ede6-3675-4b22-ba50-0357a77dbb91 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:17.862956 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-7538ede6-3675-4b22-ba50-0357a77dbb91 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:17.875026 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7538ede6-3675-4b22-ba50-0357a77dbb91 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:17.875726 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7538ede6-3675-4b22-ba50-0357a77dbb91 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:17.876719 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7538ede6-3675-4b22-ba50-0357a77dbb91 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:17.877156 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7538ede6-3675-4b22-ba50-0357a77dbb91 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:17.911311 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-7538ede6-3675-4b22-ba50-0357a77dbb91 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] HTTP exception thrown: Instance ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a could not be found. Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7538ede6-3675-4b22-ba50-0357a77dbb91 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Request method failure captured: Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a HTTP/1.1 Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wLWBpeoKgfzdsi51_hIXGB8-8_ob4HBeMDTAoZXmbR9OTdLGoz8lraAbtA1VljznsqFm8mBeIJ78unFupJffa1Ph7RVWc5vPV_d-advUcTKgjrXktbtRaRuqi5OFUWnxKh_KRm9Y1lpwiWhLhvcvORrKWnqxeDw0PGarPIqsdcU-4 Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: b044b1d7d5474351bd94eb1c90882933 Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-762570368 Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:34:17.913883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:34:17.915784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b044b1d7d5474351bd94eb1c90882933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b044b1d7d5474351bd94eb1c90882933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b044b1d7d5474351bd94eb1c90882933", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b044b1d7d5474351bd94eb1c90882933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:34:17.915784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-ServerRescueNegativeTestJSON-762570368 Jul 20 08:34:17.915784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: b044b1d7d5474351bd94eb1c90882933 Jul 20 08:34:17.915784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-762570368 Jul 20 08:34:17.915784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-ServerRescueNegativeTestJSON-762570368-project Jul 20 08:34:17.915784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:34:17.915784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:34:17.915784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: bdc9e59d03334b72a8052e0f1112523f Jul 20 08:34:17.915784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-ServerRescueNegativeTestJSON-762570368-project Jul 20 08:34:17.915784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:34:17.915784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a could not be found. Jul 20 08:34:17.915784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': 'ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a'} Jul 20 08:34:17.916562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:34:17.916562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:17.916562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:34:17.916562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:34:17.916562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:34:17.916562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:34:17.916562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:34:17.916562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:34:17.916562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:34:17.916562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:34:17.916562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a could not be found. Jul 20 08:34:17.916562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:34:17.916562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:34:17.916562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:34:17.916562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:17.916562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:34:17.916562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:34:17.916562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:34:17.916562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:34:17.916562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:34:17.917789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:34:17.917789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:34:17.917789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:34:17.917789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:34:17.917789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:34:17.917789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:34:17.917789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:34:17.917789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a could not be found. Jul 20 08:34:17.917789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:34:17.917789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:34:17.917789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:34:17.917789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:17.917789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:34:17.917789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:34:17.917789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:34:17.917789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:34:17.917789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a could not be found. Jul 20 08:34:17.917789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:34:17.921441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7538ede6-3675-4b22-ba50-0357a77dbb91 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Returning 404 to user: Instance ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:34:17.922549 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-7538ede6-3675-4b22-ba50-0357a77dbb91 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a" status: 404 len: 111 microversion: 2.1 time: 0.066115 Jul 20 08:34:17.923419 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 477/948] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:17 2022] GET /compute/v2.1/servers/ef085fb0-ca4c-4c3a-9db4-6fb9bbff4f8a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:34:17.932209 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-afc6374c-cd23-4d21-9b79-28def7f687e5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:17.942385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-afc6374c-cd23-4d21-9b79-28def7f687e5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:17.955105 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-afc6374c-cd23-4d21-9b79-28def7f687e5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:17.955555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-afc6374c-cd23-4d21-9b79-28def7f687e5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:17.956340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-afc6374c-cd23-4d21-9b79-28def7f687e5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:17.956772 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-afc6374c-cd23-4d21-9b79-28def7f687e5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:17.983865 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b125b4f2-a9a2-460e-a4e7-ba889342314f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:17.984877 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b125b4f2-a9a2-460e-a4e7-ba889342314f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:17.997223 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b125b4f2-a9a2-460e-a4e7-ba889342314f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:18.001593 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b125b4f2-a9a2-460e-a4e7-ba889342314f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:18.002431 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b125b4f2-a9a2-460e-a4e7-ba889342314f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:18.002900 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b125b4f2-a9a2-460e-a4e7-ba889342314f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:18.012309 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-afc6374c-cd23-4d21-9b79-28def7f687e5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Going to try to terminate instance {{(pid=117829) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:34:18.169041 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-afc6374c-cd23-4d21-9b79-28def7f687e5 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 204 len: 0 microversion: 2.1 time: 0.240288 Jul 20 08:34:18.172644 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 472/949] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:34:17 2022] DELETE /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:34:18.180708 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-483108ee-f02e-48ae-b792-cb0edd020a64 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:18.181410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-483108ee-f02e-48ae-b792-cb0edd020a64 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:18.187984 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-483108ee-f02e-48ae-b792-cb0edd020a64 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:18.188443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-483108ee-f02e-48ae-b792-cb0edd020a64 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:18.189416 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-483108ee-f02e-48ae-b792-cb0edd020a64 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:18.189654 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-483108ee-f02e-48ae-b792-cb0edd020a64 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:18.254836 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b125b4f2-a9a2-460e-a4e7-ba889342314f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:18.266104 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b125b4f2-a9a2-460e-a4e7-ba889342314f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1266 microversion: 2.1 time: 0.288499 Jul 20 08:34:18.269690 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 478/950] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:17 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:18.361202 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-483108ee-f02e-48ae-b792-cb0edd020a64 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:18.381174 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f82510a9-238e-4455-9ddb-92fcc51e3374 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:18.381791 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f82510a9-238e-4455-9ddb-92fcc51e3374 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:18.395085 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-483108ee-f02e-48ae-b792-cb0edd020a64 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.218613 Jul 20 08:34:18.407529 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 473/951] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:18 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:18.408470 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f82510a9-238e-4455-9ddb-92fcc51e3374 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:18.408924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f82510a9-238e-4455-9ddb-92fcc51e3374 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:18.409733 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f82510a9-238e-4455-9ddb-92fcc51e3374 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:18.410175 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f82510a9-238e-4455-9ddb-92fcc51e3374 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:18.464683 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-930f187e-2c89-423e-9672-165f8845e211 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:18.465865 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-930f187e-2c89-423e-9672-165f8845e211 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:18.483889 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f82510a9-238e-4455-9ddb-92fcc51e3374 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:18.484348 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f82510a9-238e-4455-9ddb-92fcc51e3374 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:18.484818 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.objects.instance [None req-f82510a9-238e-4455-9ddb-92fcc51e3374 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lazy-loading 'fault' on Instance uuid 659d1d17-9163-4971-9ba1-40f3f20d2650 {{(pid=117828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:34:18.492060 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-930f187e-2c89-423e-9672-165f8845e211 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:18.495716 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-930f187e-2c89-423e-9672-165f8845e211 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:18.498764 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-930f187e-2c89-423e-9672-165f8845e211 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:18.501939 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-930f187e-2c89-423e-9672-165f8845e211 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:18.565337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f82510a9-238e-4455-9ddb-92fcc51e3374 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:18.573695 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f82510a9-238e-4455-9ddb-92fcc51e3374 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 200 len: 1330 microversion: 2.1 time: 0.196734 Jul 20 08:34:18.583859 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 479/952] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:18 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 1330 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:18.608658 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-930f187e-2c89-423e-9672-165f8845e211 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:18.618044 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-930f187e-2c89-423e-9672-165f8845e211 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:18.620395 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-930f187e-2c89-423e-9672-165f8845e211 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:18.622302 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-930f187e-2c89-423e-9672-165f8845e211 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1334 microversion: 2.20 time: 0.165589 Jul 20 08:34:18.633992 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 474/953] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:34:18 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1334 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:34:19.229655 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-9dcf0af1-e421-450e-b0b0-3363f54df4ca req-659f4cde-a0d7-4b83-bd23-b5df47824993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "659d1d17-9163-4971-9ba1-40f3f20d2650", "name": "network-vif-deleted", "tag": "e37caaf1-6167-4ebe-94cd-55ea929f139d"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:19.247631 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-9dcf0af1-e421-450e-b0b0-3363f54df4ca req-659f4cde-a0d7-4b83-bd23-b5df47824993 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:19.250300 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-9dcf0af1-e421-450e-b0b0-3363f54df4ca req-659f4cde-a0d7-4b83-bd23-b5df47824993 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:19.266010 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-9dcf0af1-e421-450e-b0b0-3363f54df4ca req-659f4cde-a0d7-4b83-bd23-b5df47824993 service nova] Creating event network-vif-deleted:e37caaf1-6167-4ebe-94cd-55ea929f139d for instance 659d1d17-9163-4971-9ba1-40f3f20d2650 on hv-cinder-82308 Jul 20 08:34:19.272109 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-9dcf0af1-e421-450e-b0b0-3363f54df4ca req-659f4cde-a0d7-4b83-bd23-b5df47824993 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046352 Jul 20 08:34:19.273330 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 480/954] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:34:19.285915 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-34fcbcdd-5fe1-4017-8a7c-bb0ef81632c6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:19.286527 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-34fcbcdd-5fe1-4017-8a7c-bb0ef81632c6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:19.294553 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-34fcbcdd-5fe1-4017-8a7c-bb0ef81632c6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:19.295036 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-34fcbcdd-5fe1-4017-8a7c-bb0ef81632c6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:19.295827 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-34fcbcdd-5fe1-4017-8a7c-bb0ef81632c6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:19.296451 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-34fcbcdd-5fe1-4017-8a7c-bb0ef81632c6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:19.422089 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d7e87e13-fe5b-4fd0-9527-7a70eb5447f9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:19.432887 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d7e87e13-fe5b-4fd0-9527-7a70eb5447f9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:19.460131 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d7e87e13-fe5b-4fd0-9527-7a70eb5447f9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:19.462767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d7e87e13-fe5b-4fd0-9527-7a70eb5447f9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:19.467114 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d7e87e13-fe5b-4fd0-9527-7a70eb5447f9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:19.468456 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d7e87e13-fe5b-4fd0-9527-7a70eb5447f9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:19.677766 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d7e87e13-fe5b-4fd0-9527-7a70eb5447f9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:19.689544 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d7e87e13-fe5b-4fd0-9527-7a70eb5447f9 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.280076 Jul 20 08:34:19.690146 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 481/955] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:19 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:19.695669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-38f2731a-a935-49d9-ae09-fe907bcbcc5c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:19.696581 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-38f2731a-a935-49d9-ae09-fe907bcbcc5c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:19.707867 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-38f2731a-a935-49d9-ae09-fe907bcbcc5c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:19.708660 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-38f2731a-a935-49d9-ae09-fe907bcbcc5c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:19.709888 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-38f2731a-a935-49d9-ae09-fe907bcbcc5c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:19.710743 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-38f2731a-a935-49d9-ae09-fe907bcbcc5c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:19.736549 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-38f2731a-a935-49d9-ae09-fe907bcbcc5c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] HTTP exception thrown: Instance 659d1d17-9163-4971-9ba1-40f3f20d2650 could not be found. Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-38f2731a-a935-49d9-ae09-fe907bcbcc5c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Request method failure captured: Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 HTTP/1.1 Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wixdWG9rc5IFR0aB2pk_ZbXSzHzAQw9OV7xc6ffVi-gC9dtYrya3ESysbvKCfhbC_hvUIb5xnU9fWVg9utseHpLd4EE5IxzuhHoy9DAbH7v7TBBmqEfRBrYIOvZrsS5CsvlsB_ARu1p91yjGC4MVw6_W2whdtfwL_HLJU3zguHAXQ Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:34:19.739933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:34:19.742021 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60ee8039b1f4461c996165d5801b91f1", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:34:19.742021 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:34:19.742021 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:34:19.742021 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:34:19.742021 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:34:19.742021 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:34:19.742021 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:34:19.742021 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: e6c2070c6d2a450c887b8ca6b97c4b38 Jul 20 08:34:19.742021 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:34:19.742021 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:34:19.742021 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance 659d1d17-9163-4971-9ba1-40f3f20d2650 could not be found. Jul 20 08:34:19.742021 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': '659d1d17-9163-4971-9ba1-40f3f20d2650'} Jul 20 08:34:19.743007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:34:19.743007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:19.743007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:34:19.743007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:34:19.743007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:34:19.743007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:34:19.743007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:34:19.743007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:34:19.743007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:34:19.743007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:34:19.743007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 659d1d17-9163-4971-9ba1-40f3f20d2650 could not be found. Jul 20 08:34:19.743007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:34:19.743007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:34:19.743007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:34:19.743007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:19.743007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:34:19.743007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:34:19.743007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:34:19.743007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:34:19.743007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:34:19.744460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:34:19.744460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:34:19.744460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:34:19.744460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:34:19.744460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:34:19.744460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:34:19.744460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:34:19.744460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 659d1d17-9163-4971-9ba1-40f3f20d2650 could not be found. Jul 20 08:34:19.744460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:34:19.744460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:34:19.744460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:34:19.744460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:19.744460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:34:19.744460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:34:19.744460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:34:19.744460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:34:19.744460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 659d1d17-9163-4971-9ba1-40f3f20d2650 could not be found. Jul 20 08:34:19.744460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:34:19.745892 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-38f2731a-a935-49d9-ae09-fe907bcbcc5c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Returning 404 to user: Instance 659d1d17-9163-4971-9ba1-40f3f20d2650 could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:34:19.745892 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-38f2731a-a935-49d9-ae09-fe907bcbcc5c tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 404 len: 111 microversion: 2.1 time: 0.050671 Jul 20 08:34:19.745892 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 482/956] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:19 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:34:19.751270 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-abb8a7b6-ea90-47f4-80c6-809b5d81a5e3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:19.751922 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-abb8a7b6-ea90-47f4-80c6-809b5d81a5e3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:19.758361 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-abb8a7b6-ea90-47f4-80c6-809b5d81a5e3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:19.758857 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-abb8a7b6-ea90-47f4-80c6-809b5d81a5e3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:19.759705 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-abb8a7b6-ea90-47f4-80c6-809b5d81a5e3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:19.760143 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-abb8a7b6-ea90-47f4-80c6-809b5d81a5e3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:19.833858 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-abb8a7b6-ea90-47f4-80c6-809b5d81a5e3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:19.845102 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-abb8a7b6-ea90-47f4-80c6-809b5d81a5e3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:19.846632 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-abb8a7b6-ea90-47f4-80c6-809b5d81a5e3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:19.847760 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-abb8a7b6-ea90-47f4-80c6-809b5d81a5e3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1340 microversion: 2.20 time: 0.102906 Jul 20 08:34:19.848555 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 483/957] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:34:19 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1340 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:34:19.853896 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-975ebd70-7082-48f5-ac5a-56ffb7d477e4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '.version_select at 0x7fe39940cb80>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:19.875944 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-975ebd70-7082-48f5-ac5a-56ffb7d477e4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-512431741" status: 202 len: 0 microversion: 2.1 time: 0.026477 Jul 20 08:34:19.876517 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 484/958] 10.222.0.64 () {58 vars in 1217 bytes} [Wed Jul 20 08:34:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-512431741 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:34:20.065640 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-34fcbcdd-5fe1-4017-8a7c-bb0ef81632c6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:20.076090 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-34fcbcdd-5fe1-4017-8a7c-bb0ef81632c6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1266 microversion: 2.1 time: 0.792568 Jul 20 08:34:20.076691 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 475/959] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:19 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1266 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:20.710293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1096cbe8-6234-4307-b027-46a1e834e9c3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:20.712793 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1096cbe8-6234-4307-b027-46a1e834e9c3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:20.725895 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1096cbe8-6234-4307-b027-46a1e834e9c3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:20.726792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1096cbe8-6234-4307-b027-46a1e834e9c3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:20.727860 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1096cbe8-6234-4307-b027-46a1e834e9c3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:20.728590 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1096cbe8-6234-4307-b027-46a1e834e9c3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:20.870210 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-fa080037-8b89-45d7-b0a1-6add2ed4307d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:20.871171 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-fa080037-8b89-45d7-b0a1-6add2ed4307d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:20.880943 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa080037-8b89-45d7-b0a1-6add2ed4307d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:20.882470 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa080037-8b89-45d7-b0a1-6add2ed4307d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:20.883531 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa080037-8b89-45d7-b0a1-6add2ed4307d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:20.884152 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa080037-8b89-45d7-b0a1-6add2ed4307d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:20.962284 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1096cbe8-6234-4307-b027-46a1e834e9c3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:20.974968 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1096cbe8-6234-4307-b027-46a1e834e9c3 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1522 microversion: 2.1 time: 0.271393 Jul 20 08:34:20.976279 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 485/960] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:20 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:20.981845 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-2ebffdeb-7b18-43ab-90ad-44096859fd0a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Action: 'create', calling method: .version_select at 0x7fe39955af70>, body: {"keypair": {"name": "tempest-keypair-2112696103", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnn4d8PRUlgXpM99c9qUT+iwrThpaHx6QJhauHq7ripfdqwdUWyCDuhyujgLqgZ3tZ7VPMedOKcipDIboccp7Kfkv/tFjexWPh0fMZHf1pUQ4RfVDdaP8kncpFoOVQ8yg=="}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:21.000606 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-2ebffdeb-7b18-43ab-90ad-44096859fd0a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Getting quotas for project 60ee8039b1f4461c996165d5801b91f1. Resources: {'key_pairs'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:34:21.007968 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-2ebffdeb-7b18-43ab-90ad-44096859fd0a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Getting quotas for user e6c2070c6d2a450c887b8ca6b97c4b38 and project 60ee8039b1f4461c996165d5801b91f1. Resources: {'key_pairs'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:34:21.043514 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-2ebffdeb-7b18-43ab-90ad-44096859fd0a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065775 Jul 20 08:34:21.045228 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 486/961] 10.222.0.64 () {60 vars in 1158 bytes} [Wed Jul 20 08:34:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:34:21.052552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fa080037-8b89-45d7-b0a1-6add2ed4307d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:21.061622 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fa080037-8b89-45d7-b0a1-6add2ed4307d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:21.063253 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fa080037-8b89-45d7-b0a1-6add2ed4307d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:21.064440 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-fa080037-8b89-45d7-b0a1-6add2ed4307d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1340 microversion: 2.20 time: 0.199295 Jul 20 08:34:21.065006 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 476/962] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:34:20 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1340 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:34:21.104323 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-28547ee9-8e9d-41cc-a6c3-87ae6e075f17 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:21.105037 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-28547ee9-8e9d-41cc-a6c3-87ae6e075f17 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:21.113492 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-28547ee9-8e9d-41cc-a6c3-87ae6e075f17 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:21.114020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-28547ee9-8e9d-41cc-a6c3-87ae6e075f17 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:21.115381 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-28547ee9-8e9d-41cc-a6c3-87ae6e075f17 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:21.116052 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-28547ee9-8e9d-41cc-a6c3-87ae6e075f17 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:21.296388 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-bd2120f1-b172-4dd8-a116-6a8a318a210b req-ad7063ff-bab4-4654-859d-cf355f5c34a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e2a5142-59a5-4ff2-94ed-908fe82b5475", "tag": "5f10e926-b78d-48a1-a5ca-b29f3c55dee7"}, {"server_uuid": "ff2ea553-bf93-4f6e-b624-935ecec595b7", "name": "network-vif-deleted", "tag": "06458427-d317-4965-817d-8affbd2750e5"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:21.311887 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-bd2120f1-b172-4dd8-a116-6a8a318a210b req-ad7063ff-bab4-4654-859d-cf355f5c34a7 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:21.312425 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-bd2120f1-b172-4dd8-a116-6a8a318a210b req-ad7063ff-bab4-4654-859d-cf355f5c34a7 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:21.327528 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-bd2120f1-b172-4dd8-a116-6a8a318a210b req-ad7063ff-bab4-4654-859d-cf355f5c34a7 service nova] Creating event network-changed:5f10e926-b78d-48a1-a5ca-b29f3c55dee7 for instance 5e2a5142-59a5-4ff2-94ed-908fe82b5475 on hv-cinder-82308 Jul 20 08:34:21.328037 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-bd2120f1-b172-4dd8-a116-6a8a318a210b req-ad7063ff-bab4-4654-859d-cf355f5c34a7 service nova] Creating event network-vif-deleted:06458427-d317-4965-817d-8affbd2750e5 for instance ff2ea553-bf93-4f6e-b624-935ecec595b7 on hv-cinder-82308 Jul 20 08:34:21.335615 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-bd2120f1-b172-4dd8-a116-6a8a318a210b req-ad7063ff-bab4-4654-859d-cf355f5c34a7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.044797 Jul 20 08:34:21.336395 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 477/963] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:34:21.355263 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-28547ee9-8e9d-41cc-a6c3-87ae6e075f17 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:21.365535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-28547ee9-8e9d-41cc-a6c3-87ae6e075f17 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1266 microversion: 2.1 time: 0.265179 Jul 20 08:34:21.366158 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 487/964] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:21 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:21.993428 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f5800a81-e288-429a-b7fd-a4b46bb91457 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:21.994069 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f5800a81-e288-429a-b7fd-a4b46bb91457 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:22.001775 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f5800a81-e288-429a-b7fd-a4b46bb91457 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:22.002233 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f5800a81-e288-429a-b7fd-a4b46bb91457 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:22.003441 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f5800a81-e288-429a-b7fd-a4b46bb91457 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:22.003878 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f5800a81-e288-429a-b7fd-a4b46bb91457 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:22.083975 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c1e65e1e-5cdb-4d34-90e8-9a3d072a6e2c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:22.084899 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c1e65e1e-5cdb-4d34-90e8-9a3d072a6e2c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:22.088575 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f5800a81-e288-429a-b7fd-a4b46bb91457 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdc9e59d03334b72a8052e0f1112523f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b044b1d7d5474351bd94eb1c90882933', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:22.091650 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c1e65e1e-5cdb-4d34-90e8-9a3d072a6e2c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:22.092409 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c1e65e1e-5cdb-4d34-90e8-9a3d072a6e2c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:22.093436 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c1e65e1e-5cdb-4d34-90e8-9a3d072a6e2c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:22.093872 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c1e65e1e-5cdb-4d34-90e8-9a3d072a6e2c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:22.097991 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f5800a81-e288-429a-b7fd-a4b46bb91457 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 200 len: 1480 microversion: 2.1 time: 0.109038 Jul 20 08:34:22.098568 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 478/965] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:21 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 1480 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:22.267649 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c1e65e1e-5cdb-4d34-90e8-9a3d072a6e2c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:22.283458 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c1e65e1e-5cdb-4d34-90e8-9a3d072a6e2c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:22.285020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c1e65e1e-5cdb-4d34-90e8-9a3d072a6e2c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:22.286866 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c1e65e1e-5cdb-4d34-90e8-9a3d072a6e2c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1407 microversion: 2.20 time: 0.207004 Jul 20 08:34:22.287437 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 488/966] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:34:22 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:34:22.383783 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3817ffa1-c01b-445f-8734-9a99eb5c488f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:22.384543 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3817ffa1-c01b-445f-8734-9a99eb5c488f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:22.392131 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3817ffa1-c01b-445f-8734-9a99eb5c488f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:22.392739 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3817ffa1-c01b-445f-8734-9a99eb5c488f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:22.394125 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3817ffa1-c01b-445f-8734-9a99eb5c488f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:22.394778 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3817ffa1-c01b-445f-8734-9a99eb5c488f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:22.891033 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3817ffa1-c01b-445f-8734-9a99eb5c488f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:22.900335 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3817ffa1-c01b-445f-8734-9a99eb5c488f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1266 microversion: 2.1 time: 0.520315 Jul 20 08:34:22.901105 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 479/967] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:22 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1266 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:23.116344 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-334ce8a3-d318-48e4-85ec-b93743c8cf41 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:23.117422 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-334ce8a3-d318-48e4-85ec-b93743c8cf41 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] [instance: ff2ea553-bf93-4f6e-b624-935ecec595b7] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:23.124431 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-334ce8a3-d318-48e4-85ec-b93743c8cf41 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:23.124882 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-334ce8a3-d318-48e4-85ec-b93743c8cf41 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:23.125815 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-334ce8a3-d318-48e4-85ec-b93743c8cf41 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:23.126259 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-334ce8a3-d318-48e4-85ec-b93743c8cf41 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:23.141845 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-334ce8a3-d318-48e4-85ec-b93743c8cf41 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] HTTP exception thrown: Instance ff2ea553-bf93-4f6e-b624-935ecec595b7 could not be found. Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-334ce8a3-d318-48e4-85ec-b93743c8cf41 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Request method failure captured: Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 HTTP/1.1 Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wLWBpeoKgfzdsi51_hIXGB8-8_ob4HBeMDTAoZXmbR9OTdLGoz8lraAbtA1VljznsqFm8mBeIJ78unFupJffa1Ph7RVWc5vPV_d-advUcTKgjrXktbtRaRuqi5OFUWnxKh_KRm9Y1lpwiWhLhvcvORrKWnqxeDw0PGarPIqsdcU-4 Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: b044b1d7d5474351bd94eb1c90882933 Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-762570368 Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:34:23.143354 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:34:23.149833 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b044b1d7d5474351bd94eb1c90882933"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b044b1d7d5474351bd94eb1c90882933"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b044b1d7d5474351bd94eb1c90882933", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b044b1d7d5474351bd94eb1c90882933"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:34:23.149833 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-ServerRescueNegativeTestJSON-762570368 Jul 20 08:34:23.149833 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: b044b1d7d5474351bd94eb1c90882933 Jul 20 08:34:23.149833 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-762570368 Jul 20 08:34:23.149833 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-ServerRescueNegativeTestJSON-762570368-project Jul 20 08:34:23.149833 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:34:23.149833 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:34:23.149833 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: bdc9e59d03334b72a8052e0f1112523f Jul 20 08:34:23.149833 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-ServerRescueNegativeTestJSON-762570368-project Jul 20 08:34:23.149833 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:34:23.149833 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance ff2ea553-bf93-4f6e-b624-935ecec595b7 could not be found. Jul 20 08:34:23.149833 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': 'ff2ea553-bf93-4f6e-b624-935ecec595b7'} Jul 20 08:34:23.150788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:34:23.150788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:23.150788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:34:23.150788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:34:23.150788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:34:23.150788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:34:23.150788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:34:23.150788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:34:23.150788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:34:23.150788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:34:23.150788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff2ea553-bf93-4f6e-b624-935ecec595b7 could not be found. Jul 20 08:34:23.150788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:34:23.150788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:34:23.150788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:34:23.150788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:23.150788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:34:23.150788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:34:23.150788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:34:23.150788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:34:23.150788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:34:23.153681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:34:23.153681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:34:23.153681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:34:23.153681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:34:23.153681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:34:23.153681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:34:23.153681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:34:23.153681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff2ea553-bf93-4f6e-b624-935ecec595b7 could not be found. Jul 20 08:34:23.153681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:34:23.153681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:34:23.153681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:34:23.153681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:34:23.153681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:34:23.153681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:34:23.153681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:34:23.153681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:34:23.153681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff2ea553-bf93-4f6e-b624-935ecec595b7 could not be found. Jul 20 08:34:23.153681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:34:23.156039 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-334ce8a3-d318-48e4-85ec-b93743c8cf41 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] Returning 404 to user: Instance ff2ea553-bf93-4f6e-b624-935ecec595b7 could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:34:23.156039 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-334ce8a3-d318-48e4-85ec-b93743c8cf41 tempest-ServerRescueNegativeTestJSON-762570368 tempest-ServerRescueNegativeTestJSON-762570368-project] 10.222.0.64 "GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7" status: 404 len: 111 microversion: 2.1 time: 0.032686 Jul 20 08:34:23.156039 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 489/968] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:23 2022] GET /compute/v2.1/servers/ff2ea553-bf93-4f6e-b624-935ecec595b7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:34:23.305765 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-49e46c2b-2135-4882-8797-e5248566edaf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:23.306757 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-49e46c2b-2135-4882-8797-e5248566edaf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:23.313549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-49e46c2b-2135-4882-8797-e5248566edaf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:23.314339 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-49e46c2b-2135-4882-8797-e5248566edaf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:23.315397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-49e46c2b-2135-4882-8797-e5248566edaf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:23.316067 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-49e46c2b-2135-4882-8797-e5248566edaf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:23.922872 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7c7e7651-28dc-434d-80a7-717eca302de0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:23.923924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-7c7e7651-28dc-434d-80a7-717eca302de0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:23.932458 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7c7e7651-28dc-434d-80a7-717eca302de0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:23.933186 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7c7e7651-28dc-434d-80a7-717eca302de0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:23.934321 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7c7e7651-28dc-434d-80a7-717eca302de0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:23.935171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7c7e7651-28dc-434d-80a7-717eca302de0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:23.988874 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-49e46c2b-2135-4882-8797-e5248566edaf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:23.999601 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-49e46c2b-2135-4882-8797-e5248566edaf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:24.001704 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-49e46c2b-2135-4882-8797-e5248566edaf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:24.003578 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-49e46c2b-2135-4882-8797-e5248566edaf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1407 microversion: 2.20 time: 0.702029 Jul 20 08:34:24.004618 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 480/969] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:34:23 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1407 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:34:24.023241 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4453a425-280c-4f8a-a8f4-87e99cb78617 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-804394688", "imageRef": "5d6b971e-8afe-4e4a-b054-20cd61970c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21da7406-374d-4389-9eee-8af0140c04bf"}], "security_groups": [{"name": "tempest-securitygroup--1799131295"}], "key_name": "tempest-keypair-2112696103", "user_data": "}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:24.196505 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.network.neutron [None req-4453a425-280c-4f8a-a8f4-87e99cb78617 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] validate_networks() for [('21da7406-374d-4389-9eee-8af0140c04bf', None, None, None, None, None)] {{(pid=117829) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:34:24.211680 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-7c7e7651-28dc-434d-80a7-717eca302de0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:24.226962 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-7c7e7651-28dc-434d-80a7-717eca302de0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1266 microversion: 2.1 time: 0.308321 Jul 20 08:34:24.229766 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 490/970] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:23 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:24.281635 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-82dc8005-8cf1-430b-b66a-08dc7193dea4 req-feb2a4c3-a9c8-418e-bec1-a2836ff6822d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f9589ff-3f5c-4537-9fde-1b5e676b7e09", "tag": "08b8e9ae-c7b3-47d7-8038-a5fdfb1440e4"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:24.292657 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-82dc8005-8cf1-430b-b66a-08dc7193dea4 req-feb2a4c3-a9c8-418e-bec1-a2836ff6822d service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:24.293442 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-82dc8005-8cf1-430b-b66a-08dc7193dea4 req-feb2a4c3-a9c8-418e-bec1-a2836ff6822d service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:24.312434 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-82dc8005-8cf1-430b-b66a-08dc7193dea4 req-feb2a4c3-a9c8-418e-bec1-a2836ff6822d service nova] Creating event network-changed:08b8e9ae-c7b3-47d7-8038-a5fdfb1440e4 for instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 on hv-cinder-82308 Jul 20 08:34:24.327730 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-82dc8005-8cf1-430b-b66a-08dc7193dea4 req-feb2a4c3-a9c8-418e-bec1-a2836ff6822d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053692 Jul 20 08:34:24.329136 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 491/971] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:34:24.831252 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 08:34:24.831474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Wed Jul 20 08:34:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 08:34:24.993698 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-4453a425-280c-4f8a-a8f4-87e99cb78617 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Flavor limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:34:24.994733 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-4453a425-280c-4f8a-a8f4-87e99cb78617 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Image limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:34:24.995241 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-4453a425-280c-4f8a-a8f4-87e99cb78617 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Flavor pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:34:24.995833 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-4453a425-280c-4f8a-a8f4-87e99cb78617 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Image pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:34:24.996879 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-4453a425-280c-4f8a-a8f4-87e99cb78617 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:34:25.011458 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4453a425-280c-4f8a-a8f4-87e99cb78617 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:25.012214 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4453a425-280c-4f8a-a8f4-87e99cb78617 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:25.013348 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4453a425-280c-4f8a-a8f4-87e99cb78617 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:25.013644 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4453a425-280c-4f8a-a8f4-87e99cb78617 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:25.027798 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-077732cb-87b0-434e-81ec-14e5dd78b598 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:25.029041 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-077732cb-87b0-434e-81ec-14e5dd78b598 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:25.036087 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-4453a425-280c-4f8a-a8f4-87e99cb78617 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Getting quotas for project 60ee8039b1f4461c996165d5801b91f1. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:34:25.036300 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-077732cb-87b0-434e-81ec-14e5dd78b598 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:25.036689 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-077732cb-87b0-434e-81ec-14e5dd78b598 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:25.037616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-077732cb-87b0-434e-81ec-14e5dd78b598 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:25.038114 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-077732cb-87b0-434e-81ec-14e5dd78b598 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:25.040866 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-4453a425-280c-4f8a-a8f4-87e99cb78617 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Getting quotas for user e6c2070c6d2a450c887b8ca6b97c4b38 and project 60ee8039b1f4461c996165d5801b91f1. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:34:25.057362 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4453a425-280c-4f8a-a8f4-87e99cb78617 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Going to run 1 instances... {{(pid=117829) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:34:25.060906 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4453a425-280c-4f8a-a8f4-87e99cb78617 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d6b971e-8afe-4e4a-b054-20cd61970c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117829) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:34:25.112949 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4453a425-280c-4f8a-a8f4-87e99cb78617 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.106869 Jul 20 08:34:25.113819 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 481/972] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Jul 20 08:34:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 08:34:25.130257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8ef47f4e-9041-425c-b9c9-d52043e7e308 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:25.131248 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8ef47f4e-9041-425c-b9c9-d52043e7e308 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:25.200656 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8ef47f4e-9041-425c-b9c9-d52043e7e308 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:25.233386 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8ef47f4e-9041-425c-b9c9-d52043e7e308 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1241 microversion: 2.1 time: 0.111731 Jul 20 08:34:25.237841 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 482/973] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:25 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1241 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:25.249106 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4fc62a29-d557-4b0a-a4bf-4397c81f53a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:25.249726 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4fc62a29-d557-4b0a-a4bf-4397c81f53a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:25.278528 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4fc62a29-d557-4b0a-a4bf-4397c81f53a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:25.279256 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4fc62a29-d557-4b0a-a4bf-4397c81f53a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:25.281731 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4fc62a29-d557-4b0a-a4bf-4397c81f53a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:25.286134 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4fc62a29-d557-4b0a-a4bf-4397c81f53a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:25.325300 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-077732cb-87b0-434e-81ec-14e5dd78b598 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:25.334514 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-077732cb-87b0-434e-81ec-14e5dd78b598 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:25.336899 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-077732cb-87b0-434e-81ec-14e5dd78b598 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:25.339255 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-077732cb-87b0-434e-81ec-14e5dd78b598 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1407 microversion: 2.20 time: 0.316297 Jul 20 08:34:25.350688 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 492/974] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:34:25 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1407 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:34:25.579714 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4fc62a29-d557-4b0a-a4bf-4397c81f53a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:25.594649 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4fc62a29-d557-4b0a-a4bf-4397c81f53a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1266 microversion: 2.1 time: 0.349815 Jul 20 08:34:25.596104 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 483/975] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:25 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1266 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:26.256674 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-afa683fc-2a4a-4294-84c2-a8b3e6c521eb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:26.257463 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-afa683fc-2a4a-4294-84c2-a8b3e6c521eb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:26.273138 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-afa683fc-2a4a-4294-84c2-a8b3e6c521eb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:26.273939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-afa683fc-2a4a-4294-84c2-a8b3e6c521eb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:26.275340 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-afa683fc-2a4a-4294-84c2-a8b3e6c521eb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:26.276653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-afa683fc-2a4a-4294-84c2-a8b3e6c521eb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:26.351034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-afa683fc-2a4a-4294-84c2-a8b3e6c521eb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:26.358441 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-95929d40-0d6d-4816-876d-19b1096a2ed5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:26.359855 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-95929d40-0d6d-4816-876d-19b1096a2ed5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:26.360657 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-afa683fc-2a4a-4294-84c2-a8b3e6c521eb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1245 microversion: 2.1 time: 0.112460 Jul 20 08:34:26.369929 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-95929d40-0d6d-4816-876d-19b1096a2ed5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:26.370687 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-95929d40-0d6d-4816-876d-19b1096a2ed5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:26.371841 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-95929d40-0d6d-4816-876d-19b1096a2ed5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:26.372838 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-95929d40-0d6d-4816-876d-19b1096a2ed5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:26.374226 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 493/976] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:26 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1245 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:26.597545 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-95929d40-0d6d-4816-876d-19b1096a2ed5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:26.612552 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-95929d40-0d6d-4816-876d-19b1096a2ed5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:26.616336 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-95929d40-0d6d-4816-876d-19b1096a2ed5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:26.617621 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5a11c7e1-67fa-4ad2-97f7-48954aa4756f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:26.618734 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-95929d40-0d6d-4816-876d-19b1096a2ed5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1407 microversion: 2.20 time: 0.264833 Jul 20 08:34:26.619408 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-5a11c7e1-67fa-4ad2-97f7-48954aa4756f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:26.619947 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 484/977] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:34:26 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:34:26.628833 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5a11c7e1-67fa-4ad2-97f7-48954aa4756f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:26.629271 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5a11c7e1-67fa-4ad2-97f7-48954aa4756f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:26.630620 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5a11c7e1-67fa-4ad2-97f7-48954aa4756f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:26.631054 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5a11c7e1-67fa-4ad2-97f7-48954aa4756f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:26.916571 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5a11c7e1-67fa-4ad2-97f7-48954aa4756f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:26.935196 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-5a11c7e1-67fa-4ad2-97f7-48954aa4756f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1266 microversion: 2.1 time: 0.324387 Jul 20 08:34:26.935799 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 494/978] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:26 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1266 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:27.382025 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-154356c2-b530-48eb-970c-7a61757aa77b tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:27.382975 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-154356c2-b530-48eb-970c-7a61757aa77b tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:27.390535 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-154356c2-b530-48eb-970c-7a61757aa77b tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:27.391635 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-154356c2-b530-48eb-970c-7a61757aa77b tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:27.392437 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-154356c2-b530-48eb-970c-7a61757aa77b tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:27.392877 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-154356c2-b530-48eb-970c-7a61757aa77b tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:27.476657 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-154356c2-b530-48eb-970c-7a61757aa77b tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:27.481687 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:34:27.497693 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-154356c2-b530-48eb-970c-7a61757aa77b tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1245 microversion: 2.1 time: 0.120205 Jul 20 08:34:27.498284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 485/979] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:27 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1245 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:27.646897 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-98c86046-a0df-47a1-a086-8cdc4f5651cc tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:27.647494 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-98c86046-a0df-47a1-a086-8cdc4f5651cc tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:27.655026 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-98c86046-a0df-47a1-a086-8cdc4f5651cc tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:27.655467 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-98c86046-a0df-47a1-a086-8cdc4f5651cc tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:27.656235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-98c86046-a0df-47a1-a086-8cdc4f5651cc tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:27.656659 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-98c86046-a0df-47a1-a086-8cdc4f5651cc tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:27.835723 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-98c86046-a0df-47a1-a086-8cdc4f5651cc tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:27.844641 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-98c86046-a0df-47a1-a086-8cdc4f5651cc tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:27.846147 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-98c86046-a0df-47a1-a086-8cdc4f5651cc tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:27.847311 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-98c86046-a0df-47a1-a086-8cdc4f5651cc tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1407 microversion: 2.20 time: 0.204433 Jul 20 08:34:27.847862 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 495/980] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:34:27 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:34:27.956131 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-07fe5643-7a67-4f63-af4b-7dddbfa5c19b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:27.957143 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-07fe5643-7a67-4f63-af4b-7dddbfa5c19b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:27.965057 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-07fe5643-7a67-4f63-af4b-7dddbfa5c19b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:27.965942 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-07fe5643-7a67-4f63-af4b-7dddbfa5c19b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:27.966759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-07fe5643-7a67-4f63-af4b-7dddbfa5c19b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:27.967204 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-07fe5643-7a67-4f63-af4b-7dddbfa5c19b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:28.112840 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-07fe5643-7a67-4f63-af4b-7dddbfa5c19b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:28.120732 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-07fe5643-7a67-4f63-af4b-7dddbfa5c19b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1266 microversion: 2.1 time: 0.172354 Jul 20 08:34:28.128318 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 486/981] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:27 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:28.515166 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8a668644-b5b1-4882-b364-9c419f77b8c9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:28.515804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8a668644-b5b1-4882-b364-9c419f77b8c9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:28.522370 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8a668644-b5b1-4882-b364-9c419f77b8c9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:28.522850 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8a668644-b5b1-4882-b364-9c419f77b8c9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:28.523833 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8a668644-b5b1-4882-b364-9c419f77b8c9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:28.524269 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8a668644-b5b1-4882-b364-9c419f77b8c9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:28.595490 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-8a668644-b5b1-4882-b364-9c419f77b8c9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:28.600230 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=100 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:34:28.607676 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8a668644-b5b1-4882-b364-9c419f77b8c9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1245 microversion: 2.1 time: 0.097461 Jul 20 08:34:28.608257 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 496/982] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:28 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:28.867728 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ab959bb8-e2b5-4d9d-bde4-a10ed9d19414 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:28.868915 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ab959bb8-e2b5-4d9d-bde4-a10ed9d19414 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:28.876311 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ab959bb8-e2b5-4d9d-bde4-a10ed9d19414 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:28.876760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ab959bb8-e2b5-4d9d-bde4-a10ed9d19414 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:28.877571 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ab959bb8-e2b5-4d9d-bde4-a10ed9d19414 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:28.878014 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ab959bb8-e2b5-4d9d-bde4-a10ed9d19414 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:29.061384 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ab959bb8-e2b5-4d9d-bde4-a10ed9d19414 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:29.071834 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ab959bb8-e2b5-4d9d-bde4-a10ed9d19414 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:29.073568 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ab959bb8-e2b5-4d9d-bde4-a10ed9d19414 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:29.076497 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ab959bb8-e2b5-4d9d-bde4-a10ed9d19414 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1407 microversion: 2.20 time: 0.212437 Jul 20 08:34:29.077044 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 487/983] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:34:28 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:34:29.140550 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1f077a43-3d33-4692-b950-ba62158cc157 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:29.141147 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1f077a43-3d33-4692-b950-ba62158cc157 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:29.147811 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1f077a43-3d33-4692-b950-ba62158cc157 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:29.148258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1f077a43-3d33-4692-b950-ba62158cc157 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:29.149309 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1f077a43-3d33-4692-b950-ba62158cc157 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:29.149770 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1f077a43-3d33-4692-b950-ba62158cc157 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:29.300643 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1f077a43-3d33-4692-b950-ba62158cc157 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:29.308494 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1f077a43-3d33-4692-b950-ba62158cc157 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1266 microversion: 2.1 time: 0.173105 Jul 20 08:34:29.309683 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 497/984] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:29 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:29.626235 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-2ebaf6d2-f931-4d24-991b-dc4cb7696a67 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:29.626879 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-2ebaf6d2-f931-4d24-991b-dc4cb7696a67 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:29.632857 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2ebaf6d2-f931-4d24-991b-dc4cb7696a67 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:29.633305 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2ebaf6d2-f931-4d24-991b-dc4cb7696a67 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:29.634081 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2ebaf6d2-f931-4d24-991b-dc4cb7696a67 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:29.634520 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2ebaf6d2-f931-4d24-991b-dc4cb7696a67 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:29.699004 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-2ebaf6d2-f931-4d24-991b-dc4cb7696a67 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:29.707403 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-2ebaf6d2-f931-4d24-991b-dc4cb7696a67 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1245 microversion: 2.1 time: 0.086024 Jul 20 08:34:29.707989 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 488/985] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:29 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:30.093961 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-4a41b6ab-6ef2-4bac-a53f-788c894dd1ba tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:30.094627 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-4a41b6ab-6ef2-4bac-a53f-788c894dd1ba tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:30.100998 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4a41b6ab-6ef2-4bac-a53f-788c894dd1ba tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:30.101445 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4a41b6ab-6ef2-4bac-a53f-788c894dd1ba tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:30.102231 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4a41b6ab-6ef2-4bac-a53f-788c894dd1ba tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:30.102707 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4a41b6ab-6ef2-4bac-a53f-788c894dd1ba tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:30.244978 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-4a41b6ab-6ef2-4bac-a53f-788c894dd1ba tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:30.255463 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-4a41b6ab-6ef2-4bac-a53f-788c894dd1ba tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:30.259516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-4a41b6ab-6ef2-4bac-a53f-788c894dd1ba tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:30.260489 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-4a41b6ab-6ef2-4bac-a53f-788c894dd1ba tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1407 microversion: 2.20 time: 0.170490 Jul 20 08:34:30.276745 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 498/986] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:34:30 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:34:30.326459 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f09cb89b-8e99-4c67-b90a-1f97256882c2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:30.327209 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f09cb89b-8e99-4c67-b90a-1f97256882c2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:30.333863 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f09cb89b-8e99-4c67-b90a-1f97256882c2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:30.334307 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f09cb89b-8e99-4c67-b90a-1f97256882c2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:30.335212 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f09cb89b-8e99-4c67-b90a-1f97256882c2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:30.335641 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f09cb89b-8e99-4c67-b90a-1f97256882c2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:30.431503 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-b8bb3fa5-200e-46d9-b2b4-50a1659198e3 req-084217ef-5356-4735-a881-4040dceb973f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9589ff-3f5c-4537-9fde-1b5e676b7e09", "name": "network-vif-plugged", "status": "completed", "tag": "08b8e9ae-c7b3-47d7-8038-a5fdfb1440e4"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:30.442287 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-b8bb3fa5-200e-46d9-b2b4-50a1659198e3 req-084217ef-5356-4735-a881-4040dceb973f service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:30.443738 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-b8bb3fa5-200e-46d9-b2b4-50a1659198e3 req-084217ef-5356-4735-a881-4040dceb973f service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:30.461313 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-b8bb3fa5-200e-46d9-b2b4-50a1659198e3 req-084217ef-5356-4735-a881-4040dceb973f service nova] Creating event network-vif-plugged:08b8e9ae-c7b3-47d7-8038-a5fdfb1440e4 for instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 on hv-cinder-82308 Jul 20 08:34:30.467994 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-b8bb3fa5-200e-46d9-b2b4-50a1659198e3 req-084217ef-5356-4735-a881-4040dceb973f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040346 Jul 20 08:34:30.469254 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 499/987] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:34:30.565613 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f09cb89b-8e99-4c67-b90a-1f97256882c2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:30.573299 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f09cb89b-8e99-4c67-b90a-1f97256882c2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1266 microversion: 2.1 time: 0.250914 Jul 20 08:34:30.573867 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 489/988] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:30 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:30.724929 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5829842d-3833-477b-85a6-91fc8ef92fdf tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:30.725621 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-5829842d-3833-477b-85a6-91fc8ef92fdf tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:30.732473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5829842d-3833-477b-85a6-91fc8ef92fdf tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:30.732917 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5829842d-3833-477b-85a6-91fc8ef92fdf tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:30.733675 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5829842d-3833-477b-85a6-91fc8ef92fdf tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:30.734109 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5829842d-3833-477b-85a6-91fc8ef92fdf tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:30.800164 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5829842d-3833-477b-85a6-91fc8ef92fdf tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:30.810568 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-5829842d-3833-477b-85a6-91fc8ef92fdf tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1293 microversion: 2.1 time: 0.089720 Jul 20 08:34:30.812362 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 500/989] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:30 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:31.279867 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e50561a2-8a18-48bf-8c59-3f59135499b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:31.280900 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e50561a2-8a18-48bf-8c59-3f59135499b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:31.287286 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e50561a2-8a18-48bf-8c59-3f59135499b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:31.287734 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e50561a2-8a18-48bf-8c59-3f59135499b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:31.288525 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e50561a2-8a18-48bf-8c59-3f59135499b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:31.288963 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e50561a2-8a18-48bf-8c59-3f59135499b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:31.432948 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e50561a2-8a18-48bf-8c59-3f59135499b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:31.444381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e50561a2-8a18-48bf-8c59-3f59135499b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:31.446721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e50561a2-8a18-48bf-8c59-3f59135499b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:31.448025 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e50561a2-8a18-48bf-8c59-3f59135499b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1407 microversion: 2.20 time: 0.172726 Jul 20 08:34:31.448689 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 490/990] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:34:31 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:34:31.591740 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c9541758-2a60-4eaf-938e-2ee021b876a8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:31.592486 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c9541758-2a60-4eaf-938e-2ee021b876a8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:31.594313 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=10 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:34:31.600314 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c9541758-2a60-4eaf-938e-2ee021b876a8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:31.600763 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c9541758-2a60-4eaf-938e-2ee021b876a8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:31.601532 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c9541758-2a60-4eaf-938e-2ee021b876a8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:31.601962 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c9541758-2a60-4eaf-938e-2ee021b876a8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:31.737810 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c9541758-2a60-4eaf-938e-2ee021b876a8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:31.745327 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c9541758-2a60-4eaf-938e-2ee021b876a8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1266 microversion: 2.1 time: 0.158188 Jul 20 08:34:31.751788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 501/991] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:31 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:31.829434 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-fdb71387-703d-428b-8f16-5c6476c8f6d5 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:31.830550 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-fdb71387-703d-428b-8f16-5c6476c8f6d5 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:31.836618 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fdb71387-703d-428b-8f16-5c6476c8f6d5 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:31.837067 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fdb71387-703d-428b-8f16-5c6476c8f6d5 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:31.837850 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fdb71387-703d-428b-8f16-5c6476c8f6d5 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:31.838288 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fdb71387-703d-428b-8f16-5c6476c8f6d5 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:31.915844 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fdb71387-703d-428b-8f16-5c6476c8f6d5 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:31.923821 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-fdb71387-703d-428b-8f16-5c6476c8f6d5 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1299 microversion: 2.1 time: 0.098566 Jul 20 08:34:31.924410 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 491/992] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:31 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:32.467436 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f9e33f6e-85e2-47bb-8ec6-218a230a7e02 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:32.468155 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f9e33f6e-85e2-47bb-8ec6-218a230a7e02 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:32.471620 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:34:32.475501 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f9e33f6e-85e2-47bb-8ec6-218a230a7e02 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:32.475945 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f9e33f6e-85e2-47bb-8ec6-218a230a7e02 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:32.476717 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f9e33f6e-85e2-47bb-8ec6-218a230a7e02 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:32.477232 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f9e33f6e-85e2-47bb-8ec6-218a230a7e02 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:32.648567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f9e33f6e-85e2-47bb-8ec6-218a230a7e02 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:32.662905 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f9e33f6e-85e2-47bb-8ec6-218a230a7e02 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:32.664746 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f9e33f6e-85e2-47bb-8ec6-218a230a7e02 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:32.666142 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f9e33f6e-85e2-47bb-8ec6-218a230a7e02 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1407 microversion: 2.20 time: 0.203523 Jul 20 08:34:32.666796 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 502/993] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:34:32 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:34:32.761400 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8f3985e7-b98e-49bd-8652-7f8da1a9e03b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:32.763247 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8f3985e7-b98e-49bd-8652-7f8da1a9e03b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:32.770718 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8f3985e7-b98e-49bd-8652-7f8da1a9e03b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:32.771179 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8f3985e7-b98e-49bd-8652-7f8da1a9e03b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:32.771954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8f3985e7-b98e-49bd-8652-7f8da1a9e03b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:32.772388 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8f3985e7-b98e-49bd-8652-7f8da1a9e03b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:32.941413 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-4a99dc91-9735-4e2e-aefc-d228ad4b06a9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:32.942145 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-4a99dc91-9735-4e2e-aefc-d228ad4b06a9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:32.948512 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4a99dc91-9735-4e2e-aefc-d228ad4b06a9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:32.949689 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4a99dc91-9735-4e2e-aefc-d228ad4b06a9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:32.950759 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4a99dc91-9735-4e2e-aefc-d228ad4b06a9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:32.951289 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4a99dc91-9735-4e2e-aefc-d228ad4b06a9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:33.024932 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8f3985e7-b98e-49bd-8652-7f8da1a9e03b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:33.035914 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8f3985e7-b98e-49bd-8652-7f8da1a9e03b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1266 microversion: 2.1 time: 0.278282 Jul 20 08:34:33.036822 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 492/994] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:32 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:33.109203 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-4a99dc91-9735-4e2e-aefc-d228ad4b06a9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:33.116933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-4a99dc91-9735-4e2e-aefc-d228ad4b06a9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1367 microversion: 2.1 time: 0.179448 Jul 20 08:34:33.117851 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 503/995] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:32 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:33.420343 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-25c2592b-066e-4eac-ae6d-cb50acf74030 req-a69ae6da-9e3f-4c1b-8fe4-8fe7baf1e8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b364a329-6312-40e4-b7cf-da7b1dcaca77", "tag": "dbd1572d-238c-4ff7-9973-f63b47d0e9aa"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:33.428543 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-25c2592b-066e-4eac-ae6d-cb50acf74030 req-a69ae6da-9e3f-4c1b-8fe4-8fe7baf1e8b1 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:33.428992 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-25c2592b-066e-4eac-ae6d-cb50acf74030 req-a69ae6da-9e3f-4c1b-8fe4-8fe7baf1e8b1 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:33.444440 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-25c2592b-066e-4eac-ae6d-cb50acf74030 req-a69ae6da-9e3f-4c1b-8fe4-8fe7baf1e8b1 service nova] Creating event network-changed:dbd1572d-238c-4ff7-9973-f63b47d0e9aa for instance b364a329-6312-40e4-b7cf-da7b1dcaca77 on hv-cinder-82308 Jul 20 08:34:33.449518 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-25c2592b-066e-4eac-ae6d-cb50acf74030 req-a69ae6da-9e3f-4c1b-8fe4-8fe7baf1e8b1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035150 Jul 20 08:34:33.450123 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 493/996] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:34:33.685541 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5156e671-b1a5-48e7-bfa6-13fbc2a3901f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:33.686290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-5156e671-b1a5-48e7-bfa6-13fbc2a3901f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:33.692518 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5156e671-b1a5-48e7-bfa6-13fbc2a3901f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:33.693183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5156e671-b1a5-48e7-bfa6-13fbc2a3901f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:33.693958 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5156e671-b1a5-48e7-bfa6-13fbc2a3901f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:33.694562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5156e671-b1a5-48e7-bfa6-13fbc2a3901f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:33.880201 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5156e671-b1a5-48e7-bfa6-13fbc2a3901f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:33.890080 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5156e671-b1a5-48e7-bfa6-13fbc2a3901f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:33.891930 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5156e671-b1a5-48e7-bfa6-13fbc2a3901f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:33.893161 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-5156e671-b1a5-48e7-bfa6-13fbc2a3901f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1600 microversion: 2.20 time: 0.212944 Jul 20 08:34:33.893819 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 504/997] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:34:33 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:34:33.913198 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e578c07e-0e2e-4f04-84fd-6a2e4ed8cc20 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:33.914543 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e578c07e-0e2e-4f04-84fd-6a2e4ed8cc20 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:33.925043 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e578c07e-0e2e-4f04-84fd-6a2e4ed8cc20 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:33.925506 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e578c07e-0e2e-4f04-84fd-6a2e4ed8cc20 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:33.926303 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e578c07e-0e2e-4f04-84fd-6a2e4ed8cc20 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:33.926776 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e578c07e-0e2e-4f04-84fd-6a2e4ed8cc20 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:34.030760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e578c07e-0e2e-4f04-84fd-6a2e4ed8cc20 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.122808 Jul 20 08:34:34.031649 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 494/998] 10.222.0.64 () {60 vars in 1315 bytes} [Wed Jul 20 08:34:33 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:34:34.053806 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-aa8d1b47-3c55-4e02-b422-3acb994fa3e6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:34.054211 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-aa8d1b47-3c55-4e02-b422-3acb994fa3e6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:34.061951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aa8d1b47-3c55-4e02-b422-3acb994fa3e6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:34.062403 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aa8d1b47-3c55-4e02-b422-3acb994fa3e6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:34.063227 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aa8d1b47-3c55-4e02-b422-3acb994fa3e6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:34.063667 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aa8d1b47-3c55-4e02-b422-3acb994fa3e6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:34.135822 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ff4ecdc6-862e-4156-964d-1fc30113e5c1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:34.136525 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ff4ecdc6-862e-4156-964d-1fc30113e5c1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:34.143343 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ff4ecdc6-862e-4156-964d-1fc30113e5c1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:34.144153 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ff4ecdc6-862e-4156-964d-1fc30113e5c1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:34.145148 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ff4ecdc6-862e-4156-964d-1fc30113e5c1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:34.145642 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ff4ecdc6-862e-4156-964d-1fc30113e5c1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:34.212777 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-aa8d1b47-3c55-4e02-b422-3acb994fa3e6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:34.221705 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-aa8d1b47-3c55-4e02-b422-3acb994fa3e6 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1266 microversion: 2.1 time: 0.172087 Jul 20 08:34:34.222291 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 505/999] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:34 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:34.479234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ff4ecdc6-862e-4156-964d-1fc30113e5c1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:34.491554 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ff4ecdc6-862e-4156-964d-1fc30113e5c1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1367 microversion: 2.1 time: 0.359460 Jul 20 08:34:34.492189 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 495/1000] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:34 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:34.640771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-a0fa2475-1bd7-4279-a32c-eaeca08c122d req-c2371513-87ea-4b4a-b665-76ab2ab082a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e2a5142-59a5-4ff2-94ed-908fe82b5475", "name": "network-vif-plugged", "status": "completed", "tag": "5f10e926-b78d-48a1-a5ca-b29f3c55dee7"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:34.649183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-a0fa2475-1bd7-4279-a32c-eaeca08c122d req-c2371513-87ea-4b4a-b665-76ab2ab082a2 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:34.649621 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-a0fa2475-1bd7-4279-a32c-eaeca08c122d req-c2371513-87ea-4b4a-b665-76ab2ab082a2 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:34.663015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-a0fa2475-1bd7-4279-a32c-eaeca08c122d req-c2371513-87ea-4b4a-b665-76ab2ab082a2 service nova] Creating event network-vif-plugged:5f10e926-b78d-48a1-a5ca-b29f3c55dee7 for instance 5e2a5142-59a5-4ff2-94ed-908fe82b5475 on hv-cinder-82308 Jul 20 08:34:34.669281 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-a0fa2475-1bd7-4279-a32c-eaeca08c122d req-c2371513-87ea-4b4a-b665-76ab2ab082a2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032919 Jul 20 08:34:34.670188 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 506/1001] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:34:35.241313 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-23f06f6a-ff3c-4817-9e3a-8bccd88cb0be tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:35.242128 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-23f06f6a-ff3c-4817-9e3a-8bccd88cb0be tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:35.244495 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=6 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:34:35.245298 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=26 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:34:35.253821 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-23f06f6a-ff3c-4817-9e3a-8bccd88cb0be tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:35.254312 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-23f06f6a-ff3c-4817-9e3a-8bccd88cb0be tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:35.255168 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-23f06f6a-ff3c-4817-9e3a-8bccd88cb0be tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:35.255558 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-23f06f6a-ff3c-4817-9e3a-8bccd88cb0be tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:35.468714 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-0fe07768-d817-46ff-9f27-953a219c66a8 req-3eb45f15-f8c2-4f62-bc79-c90d514f7c01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f9589ff-3f5c-4537-9fde-1b5e676b7e09", "tag": "08b8e9ae-c7b3-47d7-8038-a5fdfb1440e4"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:35.469616 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-23f06f6a-ff3c-4817-9e3a-8bccd88cb0be tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:35.477457 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-0fe07768-d817-46ff-9f27-953a219c66a8 req-3eb45f15-f8c2-4f62-bc79-c90d514f7c01 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:35.477993 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-0fe07768-d817-46ff-9f27-953a219c66a8 req-3eb45f15-f8c2-4f62-bc79-c90d514f7c01 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:35.478119 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-23f06f6a-ff3c-4817-9e3a-8bccd88cb0be tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1266 microversion: 2.1 time: 0.241603 Jul 20 08:34:35.488260 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 496/1002] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:35 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:35.490278 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-0fe07768-d817-46ff-9f27-953a219c66a8 req-3eb45f15-f8c2-4f62-bc79-c90d514f7c01 service nova] Creating event network-changed:08b8e9ae-c7b3-47d7-8038-a5fdfb1440e4 for instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 on hv-cinder-82308 Jul 20 08:34:35.496359 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-0fe07768-d817-46ff-9f27-953a219c66a8 req-3eb45f15-f8c2-4f62-bc79-c90d514f7c01 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033356 Jul 20 08:34:35.496964 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 507/1003] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:34:35.508037 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e6396e8d-4a41-4356-bbcf-826126173fac tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:35.508715 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e6396e8d-4a41-4356-bbcf-826126173fac tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:35.516388 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e6396e8d-4a41-4356-bbcf-826126173fac tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:35.516843 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e6396e8d-4a41-4356-bbcf-826126173fac tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:35.517670 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e6396e8d-4a41-4356-bbcf-826126173fac tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:35.518104 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e6396e8d-4a41-4356-bbcf-826126173fac tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:35.670832 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e6396e8d-4a41-4356-bbcf-826126173fac tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:35.680771 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e6396e8d-4a41-4356-bbcf-826126173fac tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1367 microversion: 2.1 time: 0.176405 Jul 20 08:34:35.681618 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 497/1004] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:35 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:36.497377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-630957f6-6800-4c40-bc96-307b9c80ad46 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:36.498787 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-630957f6-6800-4c40-bc96-307b9c80ad46 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:36.511374 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-630957f6-6800-4c40-bc96-307b9c80ad46 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:36.512370 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-630957f6-6800-4c40-bc96-307b9c80ad46 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:36.514118 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-630957f6-6800-4c40-bc96-307b9c80ad46 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:36.515157 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-630957f6-6800-4c40-bc96-307b9c80ad46 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:36.669162 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-630957f6-6800-4c40-bc96-307b9c80ad46 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:36.677892 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-630957f6-6800-4c40-bc96-307b9c80ad46 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1266 microversion: 2.1 time: 0.186496 Jul 20 08:34:36.678497 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 508/1005] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:36 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:36.698980 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9375b26b-94d4-4a92-b0dc-354eedf83278 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:36.699598 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9375b26b-94d4-4a92-b0dc-354eedf83278 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:36.706523 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9375b26b-94d4-4a92-b0dc-354eedf83278 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:36.706988 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9375b26b-94d4-4a92-b0dc-354eedf83278 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:36.707763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9375b26b-94d4-4a92-b0dc-354eedf83278 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:36.708200 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9375b26b-94d4-4a92-b0dc-354eedf83278 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:36.852774 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9375b26b-94d4-4a92-b0dc-354eedf83278 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:36.860970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9375b26b-94d4-4a92-b0dc-354eedf83278 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1367 microversion: 2.1 time: 0.166224 Jul 20 08:34:36.861581 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 498/1006] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:36 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:37.695941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7a338ece-f733-4e13-bb96-cf4baf9fa19e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:37.695941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-7a338ece-f733-4e13-bb96-cf4baf9fa19e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:37.702730 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7a338ece-f733-4e13-bb96-cf4baf9fa19e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:37.703736 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7a338ece-f733-4e13-bb96-cf4baf9fa19e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:37.703983 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7a338ece-f733-4e13-bb96-cf4baf9fa19e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:37.704437 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7a338ece-f733-4e13-bb96-cf4baf9fa19e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:37.847767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-7a338ece-f733-4e13-bb96-cf4baf9fa19e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:37.855914 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-7a338ece-f733-4e13-bb96-cf4baf9fa19e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1266 microversion: 2.1 time: 0.164765 Jul 20 08:34:37.856593 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 509/1007] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:37 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:37.879145 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-653ecc99-a648-4c6c-ae24-6fa19a48d689 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:37.879951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-653ecc99-a648-4c6c-ae24-6fa19a48d689 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:37.887101 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-653ecc99-a648-4c6c-ae24-6fa19a48d689 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:37.887625 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-653ecc99-a648-4c6c-ae24-6fa19a48d689 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:37.888449 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-653ecc99-a648-4c6c-ae24-6fa19a48d689 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:37.888887 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-653ecc99-a648-4c6c-ae24-6fa19a48d689 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:38.210663 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-653ecc99-a648-4c6c-ae24-6fa19a48d689 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:38.221483 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-653ecc99-a648-4c6c-ae24-6fa19a48d689 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1367 microversion: 2.1 time: 0.346919 Jul 20 08:34:38.222317 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 499/1008] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:37 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1367 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:38.873759 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d017808c-7ac4-4c84-b5f7-278a4f5459ce tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:38.874393 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d017808c-7ac4-4c84-b5f7-278a4f5459ce tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:38.881090 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d017808c-7ac4-4c84-b5f7-278a4f5459ce tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:38.881538 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d017808c-7ac4-4c84-b5f7-278a4f5459ce tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:38.882311 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d017808c-7ac4-4c84-b5f7-278a4f5459ce tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:38.882786 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d017808c-7ac4-4c84-b5f7-278a4f5459ce tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:39.021863 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d017808c-7ac4-4c84-b5f7-278a4f5459ce tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:39.030942 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d017808c-7ac4-4c84-b5f7-278a4f5459ce tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1266 microversion: 2.1 time: 0.161348 Jul 20 08:34:39.031529 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 510/1009] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:38 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:39.238997 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a7a45ca3-357b-449e-a163-b5ac5ecfeeb2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:39.239694 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a7a45ca3-357b-449e-a163-b5ac5ecfeeb2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:39.251716 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:34:39.253910 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a7a45ca3-357b-449e-a163-b5ac5ecfeeb2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:39.254548 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a7a45ca3-357b-449e-a163-b5ac5ecfeeb2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:39.255381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a7a45ca3-357b-449e-a163-b5ac5ecfeeb2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:39.255985 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a7a45ca3-357b-449e-a163-b5ac5ecfeeb2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:39.458953 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a7a45ca3-357b-449e-a163-b5ac5ecfeeb2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:39.466690 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a7a45ca3-357b-449e-a163-b5ac5ecfeeb2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1367 microversion: 2.1 time: 0.231740 Jul 20 08:34:39.467266 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 500/1010] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:39 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:40.048934 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-57761c3c-87a3-49fa-ad40-3ac15cdb3ed1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:40.049579 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-57761c3c-87a3-49fa-ad40-3ac15cdb3ed1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:40.057129 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-57761c3c-87a3-49fa-ad40-3ac15cdb3ed1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:40.057713 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-57761c3c-87a3-49fa-ad40-3ac15cdb3ed1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:40.059455 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-57761c3c-87a3-49fa-ad40-3ac15cdb3ed1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:40.059900 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-57761c3c-87a3-49fa-ad40-3ac15cdb3ed1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:40.204901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-57761c3c-87a3-49fa-ad40-3ac15cdb3ed1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:40.212718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-57761c3c-87a3-49fa-ad40-3ac15cdb3ed1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1266 microversion: 2.1 time: 0.167907 Jul 20 08:34:40.213298 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 511/1011] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:40 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:40.484368 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8a63ce2a-1157-4add-a6c6-cec1c5796a19 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:40.484964 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8a63ce2a-1157-4add-a6c6-cec1c5796a19 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:40.492128 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8a63ce2a-1157-4add-a6c6-cec1c5796a19 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:40.492573 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8a63ce2a-1157-4add-a6c6-cec1c5796a19 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:40.493355 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8a63ce2a-1157-4add-a6c6-cec1c5796a19 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:40.493788 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8a63ce2a-1157-4add-a6c6-cec1c5796a19 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:40.769013 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8a63ce2a-1157-4add-a6c6-cec1c5796a19 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:40.780741 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8a63ce2a-1157-4add-a6c6-cec1c5796a19 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1367 microversion: 2.1 time: 0.300835 Jul 20 08:34:40.784020 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 501/1012] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:40 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:40.843246 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-3ed4f3b6-422a-454a-a495-798aa8f1d190 req-9176fb6d-5059-4171-a642-c1b5ae03c3cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b364a329-6312-40e4-b7cf-da7b1dcaca77", "name": "network-vif-plugged", "status": "completed", "tag": "dbd1572d-238c-4ff7-9973-f63b47d0e9aa"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:40.845619 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-3ed4f3b6-422a-454a-a495-798aa8f1d190 req-9176fb6d-5059-4171-a642-c1b5ae03c3cb service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:40.846060 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-3ed4f3b6-422a-454a-a495-798aa8f1d190 req-9176fb6d-5059-4171-a642-c1b5ae03c3cb service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:40.860087 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-3ed4f3b6-422a-454a-a495-798aa8f1d190 req-9176fb6d-5059-4171-a642-c1b5ae03c3cb service nova] Creating event network-vif-plugged:dbd1572d-238c-4ff7-9973-f63b47d0e9aa for instance b364a329-6312-40e4-b7cf-da7b1dcaca77 on hv-cinder-82308 Jul 20 08:34:40.865425 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-3ed4f3b6-422a-454a-a495-798aa8f1d190 req-9176fb6d-5059-4171-a642-c1b5ae03c3cb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033251 Jul 20 08:34:40.866474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 512/1013] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:34:41.231258 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-7fccfd1b-6afe-468a-a3f3-c3130ca9eee8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:41.231933 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-7fccfd1b-6afe-468a-a3f3-c3130ca9eee8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:41.239273 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7fccfd1b-6afe-468a-a3f3-c3130ca9eee8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:41.239753 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7fccfd1b-6afe-468a-a3f3-c3130ca9eee8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:41.240518 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7fccfd1b-6afe-468a-a3f3-c3130ca9eee8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:41.240947 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7fccfd1b-6afe-468a-a3f3-c3130ca9eee8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:41.437194 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-7fccfd1b-6afe-468a-a3f3-c3130ca9eee8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:41.444868 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-7fccfd1b-6afe-468a-a3f3-c3130ca9eee8 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1452 microversion: 2.1 time: 0.218334 Jul 20 08:34:41.445432 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 502/1014] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:41 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1452 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:41.462236 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7aef96d9-7b24-494f-aa23-277b6cfe2a51 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:41.462961 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-7aef96d9-7b24-494f-aa23-277b6cfe2a51 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:41.469825 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7aef96d9-7b24-494f-aa23-277b6cfe2a51 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:41.470280 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7aef96d9-7b24-494f-aa23-277b6cfe2a51 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:41.471086 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7aef96d9-7b24-494f-aa23-277b6cfe2a51 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:41.471578 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7aef96d9-7b24-494f-aa23-277b6cfe2a51 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:41.605786 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-7aef96d9-7b24-494f-aa23-277b6cfe2a51 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:41.613322 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-7aef96d9-7b24-494f-aa23-277b6cfe2a51 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1452 microversion: 2.1 time: 0.155844 Jul 20 08:34:41.613896 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 513/1015] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:41 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:41.801930 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a31cf28d-b237-4c8a-8a8c-3e4d61b15c34 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:41.802619 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a31cf28d-b237-4c8a-8a8c-3e4d61b15c34 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:41.809791 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a31cf28d-b237-4c8a-8a8c-3e4d61b15c34 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:41.810249 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a31cf28d-b237-4c8a-8a8c-3e4d61b15c34 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:41.811050 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a31cf28d-b237-4c8a-8a8c-3e4d61b15c34 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:41.811483 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a31cf28d-b237-4c8a-8a8c-3e4d61b15c34 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:41.832759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:34:42.040429 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a31cf28d-b237-4c8a-8a8c-3e4d61b15c34 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:42.048827 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a31cf28d-b237-4c8a-8a8c-3e4d61b15c34 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1367 microversion: 2.1 time: 0.251058 Jul 20 08:34:42.049405 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 503/1016] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:41 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:43.067249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e2c9b845-8869-4abe-96c5-2bdbeb71db1a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:43.068791 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-e2c9b845-8869-4abe-96c5-2bdbeb71db1a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:43.077358 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e2c9b845-8869-4abe-96c5-2bdbeb71db1a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:43.078280 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e2c9b845-8869-4abe-96c5-2bdbeb71db1a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:43.079215 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e2c9b845-8869-4abe-96c5-2bdbeb71db1a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:43.079714 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e2c9b845-8869-4abe-96c5-2bdbeb71db1a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:43.233479 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e2c9b845-8869-4abe-96c5-2bdbeb71db1a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:43.242410 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e2c9b845-8869-4abe-96c5-2bdbeb71db1a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1367 microversion: 2.1 time: 0.179588 Jul 20 08:34:43.243407 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 514/1017] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:43 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:43.336242 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-4dae86d6-75c2-409b-a48e-89b8ceab6c0f req-f72216e7-9676-4293-88d7-9792137e95e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e2a5142-59a5-4ff2-94ed-908fe82b5475", "tag": "5f10e926-b78d-48a1-a5ca-b29f3c55dee7"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:43.355565 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-4dae86d6-75c2-409b-a48e-89b8ceab6c0f req-f72216e7-9676-4293-88d7-9792137e95e2 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:43.355565 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-4dae86d6-75c2-409b-a48e-89b8ceab6c0f req-f72216e7-9676-4293-88d7-9792137e95e2 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:43.364740 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-4dae86d6-75c2-409b-a48e-89b8ceab6c0f req-f72216e7-9676-4293-88d7-9792137e95e2 service nova] Creating event network-changed:5f10e926-b78d-48a1-a5ca-b29f3c55dee7 for instance 5e2a5142-59a5-4ff2-94ed-908fe82b5475 on hv-cinder-82308 Jul 20 08:34:43.370468 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-4dae86d6-75c2-409b-a48e-89b8ceab6c0f req-f72216e7-9676-4293-88d7-9792137e95e2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038129 Jul 20 08:34:43.371309 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 504/1018] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:34:43.893047 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-94003215-e62a-4168-9247-b9832bb8b7ba tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:43.893528 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-94003215-e62a-4168-9247-b9832bb8b7ba tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:43.899747 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-94003215-e62a-4168-9247-b9832bb8b7ba tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:43.900196 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-94003215-e62a-4168-9247-b9832bb8b7ba tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:43.900963 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-94003215-e62a-4168-9247-b9832bb8b7ba tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:43.901390 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-94003215-e62a-4168-9247-b9832bb8b7ba tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:43.927511 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.objects.instance [None req-94003215-e62a-4168-9247-b9832bb8b7ba tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lazy-loading 'flavor' on Instance uuid e518b913-0606-4cd9-96f7-dfcf59ff8758 {{(pid=117828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:34:43.951068 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:34:44.021131 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-94003215-e62a-4168-9247-b9832bb8b7ba tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "POST /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758/action" status: 202 len: 0 microversion: 2.1 time: 0.132776 Jul 20 08:34:44.021760 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 515/1019] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Jul 20 08:34:43 2022] POST /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:34:44.032340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c69faf94-a68f-454a-8fc9-bc0aaa71bedb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:44.032851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c69faf94-a68f-454a-8fc9-bc0aaa71bedb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:44.046498 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c69faf94-a68f-454a-8fc9-bc0aaa71bedb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:44.047304 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c69faf94-a68f-454a-8fc9-bc0aaa71bedb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:44.048278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c69faf94-a68f-454a-8fc9-bc0aaa71bedb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:44.049123 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c69faf94-a68f-454a-8fc9-bc0aaa71bedb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:44.253315 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c69faf94-a68f-454a-8fc9-bc0aaa71bedb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:44.260208 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b9dfc5e0-1e26-4b34-a478-496c3093b420 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:44.261373 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b9dfc5e0-1e26-4b34-a478-496c3093b420 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:44.261575 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c69faf94-a68f-454a-8fc9-bc0aaa71bedb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1567 microversion: 2.1 time: 0.234938 Jul 20 08:34:44.262159 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 505/1020] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:44 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:44.269726 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b9dfc5e0-1e26-4b34-a478-496c3093b420 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:44.270343 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b9dfc5e0-1e26-4b34-a478-496c3093b420 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:44.271977 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b9dfc5e0-1e26-4b34-a478-496c3093b420 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:44.272511 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b9dfc5e0-1e26-4b34-a478-496c3093b420 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:44.428143 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b9dfc5e0-1e26-4b34-a478-496c3093b420 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:44.440590 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b9dfc5e0-1e26-4b34-a478-496c3093b420 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1556 microversion: 2.1 time: 0.184189 Jul 20 08:34:44.447394 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 516/1021] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:44 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1556 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:44.463275 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c655de6d-bfc1-42ec-83c9-947a7752f429 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:44.463839 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c655de6d-bfc1-42ec-83c9-947a7752f429 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:44.474841 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c655de6d-bfc1-42ec-83c9-947a7752f429 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:44.475643 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c655de6d-bfc1-42ec-83c9-947a7752f429 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:44.476421 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c655de6d-bfc1-42ec-83c9-947a7752f429 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:44.476852 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c655de6d-bfc1-42ec-83c9-947a7752f429 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:44.644489 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c655de6d-bfc1-42ec-83c9-947a7752f429 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185046 Jul 20 08:34:44.645523 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 506/1022] 10.222.0.64 () {58 vars in 1274 bytes} [Wed Jul 20 08:34:44 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77/os-interface => generated 284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:34:45.280566 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8cffafb6-1b97-4756-a3dc-bf7b63a841ce tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:45.281158 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8cffafb6-1b97-4756-a3dc-bf7b63a841ce tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:45.288462 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8cffafb6-1b97-4756-a3dc-bf7b63a841ce tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:45.288905 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8cffafb6-1b97-4756-a3dc-bf7b63a841ce tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:45.289743 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8cffafb6-1b97-4756-a3dc-bf7b63a841ce tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:45.290171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8cffafb6-1b97-4756-a3dc-bf7b63a841ce tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:45.745247 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-8cffafb6-1b97-4756-a3dc-bf7b63a841ce tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:45.753047 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8cffafb6-1b97-4756-a3dc-bf7b63a841ce tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1567 microversion: 2.1 time: 0.477773 Jul 20 08:34:45.753642 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 517/1023] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:45 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1567 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:46.041747 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-52418df9-e3d0-431a-98a3-eb5a96bff833 req-23a22c5e-7f05-47a2-9bfc-49e5e3db4738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b364a329-6312-40e4-b7cf-da7b1dcaca77", "tag": "dbd1572d-238c-4ff7-9973-f63b47d0e9aa"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:46.055257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-52418df9-e3d0-431a-98a3-eb5a96bff833 req-23a22c5e-7f05-47a2-9bfc-49e5e3db4738 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:46.055257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-52418df9-e3d0-431a-98a3-eb5a96bff833 req-23a22c5e-7f05-47a2-9bfc-49e5e3db4738 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:46.066902 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-52418df9-e3d0-431a-98a3-eb5a96bff833 req-23a22c5e-7f05-47a2-9bfc-49e5e3db4738 service nova] Creating event network-changed:dbd1572d-238c-4ff7-9973-f63b47d0e9aa for instance b364a329-6312-40e4-b7cf-da7b1dcaca77 on hv-cinder-82308 Jul 20 08:34:46.073037 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-52418df9-e3d0-431a-98a3-eb5a96bff833 req-23a22c5e-7f05-47a2-9bfc-49e5e3db4738 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035512 Jul 20 08:34:46.074319 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 507/1024] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:34:46.779021 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-aa42d849-8fde-4c13-b214-f9a798f3cebe tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:46.780176 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-aa42d849-8fde-4c13-b214-f9a798f3cebe tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:46.790900 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aa42d849-8fde-4c13-b214-f9a798f3cebe tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:46.791342 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aa42d849-8fde-4c13-b214-f9a798f3cebe tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:46.793949 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aa42d849-8fde-4c13-b214-f9a798f3cebe tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:46.794788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aa42d849-8fde-4c13-b214-f9a798f3cebe tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:46.981045 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-aa42d849-8fde-4c13-b214-f9a798f3cebe tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:46.990160 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-aa42d849-8fde-4c13-b214-f9a798f3cebe tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1567 microversion: 2.1 time: 0.222132 Jul 20 08:34:46.990963 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 518/1025] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:46 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:48.010543 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a00b4e6c-d8ed-4454-90ef-d72b351bcdae tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:48.012213 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a00b4e6c-d8ed-4454-90ef-d72b351bcdae tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:48.019310 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a00b4e6c-d8ed-4454-90ef-d72b351bcdae tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:48.019712 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a00b4e6c-d8ed-4454-90ef-d72b351bcdae tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:48.020498 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a00b4e6c-d8ed-4454-90ef-d72b351bcdae tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:48.020939 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a00b4e6c-d8ed-4454-90ef-d72b351bcdae tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:48.428396 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a00b4e6c-d8ed-4454-90ef-d72b351bcdae tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:48.436483 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a00b4e6c-d8ed-4454-90ef-d72b351bcdae tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1567 microversion: 2.1 time: 0.431235 Jul 20 08:34:48.437050 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 508/1026] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:48 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1567 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:49.454780 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-65bb0d07-a449-41bd-881c-e8ae28253208 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:49.455749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-65bb0d07-a449-41bd-881c-e8ae28253208 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:49.462482 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-65bb0d07-a449-41bd-881c-e8ae28253208 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:49.463008 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-65bb0d07-a449-41bd-881c-e8ae28253208 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:49.464243 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-65bb0d07-a449-41bd-881c-e8ae28253208 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:49.464684 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-65bb0d07-a449-41bd-881c-e8ae28253208 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:49.601935 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-65bb0d07-a449-41bd-881c-e8ae28253208 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:49.610295 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-65bb0d07-a449-41bd-881c-e8ae28253208 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1567 microversion: 2.1 time: 0.159797 Jul 20 08:34:49.610936 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 519/1027] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:49 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:50.634448 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3cd4b9b3-2354-490e-b97e-1ce4815e6be3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:50.635597 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3cd4b9b3-2354-490e-b97e-1ce4815e6be3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:50.658382 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3cd4b9b3-2354-490e-b97e-1ce4815e6be3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:50.659113 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3cd4b9b3-2354-490e-b97e-1ce4815e6be3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:50.660494 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3cd4b9b3-2354-490e-b97e-1ce4815e6be3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:50.661275 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3cd4b9b3-2354-490e-b97e-1ce4815e6be3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:50.856041 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3cd4b9b3-2354-490e-b97e-1ce4815e6be3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:50.864899 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3cd4b9b3-2354-490e-b97e-1ce4815e6be3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1567 microversion: 2.1 time: 0.236830 Jul 20 08:34:50.865506 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 509/1028] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:50 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:51.883690 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a29b4b98-7b00-4a0d-ae22-05bc616e9c07 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:51.884292 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a29b4b98-7b00-4a0d-ae22-05bc616e9c07 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:51.891648 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a29b4b98-7b00-4a0d-ae22-05bc616e9c07 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:51.892092 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a29b4b98-7b00-4a0d-ae22-05bc616e9c07 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:51.892845 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a29b4b98-7b00-4a0d-ae22-05bc616e9c07 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:51.893270 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a29b4b98-7b00-4a0d-ae22-05bc616e9c07 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:52.033224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a29b4b98-7b00-4a0d-ae22-05bc616e9c07 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:52.041255 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a29b4b98-7b00-4a0d-ae22-05bc616e9c07 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1567 microversion: 2.1 time: 0.161306 Jul 20 08:34:52.042550 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 520/1029] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:51 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:53.060453 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-78b7f8e4-04d6-4378-acbc-39468ed42800 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:53.061078 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-78b7f8e4-04d6-4378-acbc-39468ed42800 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:53.069779 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-78b7f8e4-04d6-4378-acbc-39468ed42800 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:53.070223 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-78b7f8e4-04d6-4378-acbc-39468ed42800 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:53.071043 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-78b7f8e4-04d6-4378-acbc-39468ed42800 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:53.071477 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-78b7f8e4-04d6-4378-acbc-39468ed42800 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:53.254077 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-78b7f8e4-04d6-4378-acbc-39468ed42800 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:53.262448 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-78b7f8e4-04d6-4378-acbc-39468ed42800 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1567 microversion: 2.1 time: 0.206903 Jul 20 08:34:53.263387 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 510/1030] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:53 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:54.279742 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-92719cdf-bbad-4376-8e3a-9aac4964fa3e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:54.280526 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-92719cdf-bbad-4376-8e3a-9aac4964fa3e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:54.287363 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-92719cdf-bbad-4376-8e3a-9aac4964fa3e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:54.287962 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-92719cdf-bbad-4376-8e3a-9aac4964fa3e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:54.288873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-92719cdf-bbad-4376-8e3a-9aac4964fa3e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:54.289387 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-92719cdf-bbad-4376-8e3a-9aac4964fa3e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:54.454896 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-92719cdf-bbad-4376-8e3a-9aac4964fa3e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:54.462843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-92719cdf-bbad-4376-8e3a-9aac4964fa3e tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1567 microversion: 2.1 time: 0.187157 Jul 20 08:34:54.464280 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 521/1031] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:54 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:55.481007 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e678a7fe-e1b7-4491-85c2-59c9aa7c84ae tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:55.481566 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e678a7fe-e1b7-4491-85c2-59c9aa7c84ae tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:55.488983 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e678a7fe-e1b7-4491-85c2-59c9aa7c84ae tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:55.489404 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e678a7fe-e1b7-4491-85c2-59c9aa7c84ae tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:55.490194 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e678a7fe-e1b7-4491-85c2-59c9aa7c84ae tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:55.490662 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e678a7fe-e1b7-4491-85c2-59c9aa7c84ae tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:55.638467 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e678a7fe-e1b7-4491-85c2-59c9aa7c84ae tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:55.646468 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e678a7fe-e1b7-4491-85c2-59c9aa7c84ae tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1567 microversion: 2.1 time: 0.170089 Jul 20 08:34:55.647079 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 511/1032] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:55 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:56.664313 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8b4ab71b-7078-4df6-8b64-89be62e99ee7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:56.664954 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8b4ab71b-7078-4df6-8b64-89be62e99ee7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:56.672580 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8b4ab71b-7078-4df6-8b64-89be62e99ee7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:56.673041 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8b4ab71b-7078-4df6-8b64-89be62e99ee7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:56.673973 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8b4ab71b-7078-4df6-8b64-89be62e99ee7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:56.674533 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8b4ab71b-7078-4df6-8b64-89be62e99ee7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:56.839572 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-8b4ab71b-7078-4df6-8b64-89be62e99ee7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:56.848374 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8b4ab71b-7078-4df6-8b64-89be62e99ee7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1567 microversion: 2.1 time: 0.187910 Jul 20 08:34:56.848967 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 522/1033] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:56 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:57.865806 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-367442f3-1625-4b10-8d9f-5e38bb71c19f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:57.866479 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-367442f3-1625-4b10-8d9f-5e38bb71c19f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:57.874216 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-367442f3-1625-4b10-8d9f-5e38bb71c19f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:57.874690 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-367442f3-1625-4b10-8d9f-5e38bb71c19f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:57.875493 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-367442f3-1625-4b10-8d9f-5e38bb71c19f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:57.875913 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-367442f3-1625-4b10-8d9f-5e38bb71c19f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:58.079295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-367442f3-1625-4b10-8d9f-5e38bb71c19f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:58.088234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-367442f3-1625-4b10-8d9f-5e38bb71c19f tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1568 microversion: 2.1 time: 0.226602 Jul 20 08:34:58.094629 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 512/1034] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:57 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:34:58.112294 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d8ec3224-a69c-4340-956d-aea4a1220cb9 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:34:58.113502 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d8ec3224-a69c-4340-956d-aea4a1220cb9 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:58.122013 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d8ec3224-a69c-4340-956d-aea4a1220cb9 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:58.122368 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d8ec3224-a69c-4340-956d-aea4a1220cb9 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:58.123202 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d8ec3224-a69c-4340-956d-aea4a1220cb9 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:58.123637 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d8ec3224-a69c-4340-956d-aea4a1220cb9 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:58.225094 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d8ec3224-a69c-4340-956d-aea4a1220cb9 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "POST /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758/action" status: 202 len: 0 microversion: 2.1 time: 0.116587 Jul 20 08:34:58.226394 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 523/1035] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Jul 20 08:34:58 2022] POST /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:34:58.236386 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-72193c73-40d1-4289-8a7f-76455ae0e91d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:58.237462 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-72193c73-40d1-4289-8a7f-76455ae0e91d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:58.247084 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-72193c73-40d1-4289-8a7f-76455ae0e91d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:58.247988 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-72193c73-40d1-4289-8a7f-76455ae0e91d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:58.249135 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-72193c73-40d1-4289-8a7f-76455ae0e91d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:58.249817 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-72193c73-40d1-4289-8a7f-76455ae0e91d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:58.435042 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-72193c73-40d1-4289-8a7f-76455ae0e91d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:58.445802 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-72193c73-40d1-4289-8a7f-76455ae0e91d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1516 microversion: 2.1 time: 0.214775 Jul 20 08:34:58.446711 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 513/1036] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:58 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1516 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:34:59.472040 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b47d1ab9-cfba-4bf5-80fe-b35e37ab6695 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:34:59.472652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b47d1ab9-cfba-4bf5-80fe-b35e37ab6695 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:34:59.479132 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b47d1ab9-cfba-4bf5-80fe-b35e37ab6695 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:59.479866 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b47d1ab9-cfba-4bf5-80fe-b35e37ab6695 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:59.480908 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b47d1ab9-cfba-4bf5-80fe-b35e37ab6695 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:34:59.481347 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b47d1ab9-cfba-4bf5-80fe-b35e37ab6695 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:34:59.676651 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b47d1ab9-cfba-4bf5-80fe-b35e37ab6695 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:34:59.696068 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b47d1ab9-cfba-4bf5-80fe-b35e37ab6695 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1518 microversion: 2.1 time: 0.232633 Jul 20 08:34:59.697399 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 524/1037] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:34:59 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1518 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:00.720791 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-2663711d-b448-4892-8456-4108e1bc2e8d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:00.722384 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-2663711d-b448-4892-8456-4108e1bc2e8d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:00.735147 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2663711d-b448-4892-8456-4108e1bc2e8d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:00.736045 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2663711d-b448-4892-8456-4108e1bc2e8d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:00.737029 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2663711d-b448-4892-8456-4108e1bc2e8d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:00.738151 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2663711d-b448-4892-8456-4108e1bc2e8d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:00.795607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-cfa8830d-91d5-41ec-85fe-e3eca2bfbaa3 req-1045b28d-46ce-47f2-a5e4-5faa7be71dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e518b913-0606-4cd9-96f7-dfcf59ff8758", "name": "network-vif-unplugged", "status": "completed", "tag": "74d72a98-84ae-4d18-bd71-3bf590c0a455"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:35:00.809628 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-cfa8830d-91d5-41ec-85fe-e3eca2bfbaa3 req-1045b28d-46ce-47f2-a5e4-5faa7be71dc3 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:00.810922 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-cfa8830d-91d5-41ec-85fe-e3eca2bfbaa3 req-1045b28d-46ce-47f2-a5e4-5faa7be71dc3 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:00.828040 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-cfa8830d-91d5-41ec-85fe-e3eca2bfbaa3 req-1045b28d-46ce-47f2-a5e4-5faa7be71dc3 service nova] Creating event network-vif-unplugged:74d72a98-84ae-4d18-bd71-3bf590c0a455 for instance e518b913-0606-4cd9-96f7-dfcf59ff8758 on hv-cinder-82308 Jul 20 08:35:00.834674 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-cfa8830d-91d5-41ec-85fe-e3eca2bfbaa3 req-1045b28d-46ce-47f2-a5e4-5faa7be71dc3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046012 Jul 20 08:35:00.836634 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 525/1038] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:35:00.969183 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-2663711d-b448-4892-8456-4108e1bc2e8d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:00.985261 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-2663711d-b448-4892-8456-4108e1bc2e8d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1574 microversion: 2.1 time: 0.273888 Jul 20 08:35:00.987144 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 514/1039] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:00 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1574 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:02.016104 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f0e3c13b-5d7c-4578-af4a-c6068e16fb1a tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:02.016800 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f0e3c13b-5d7c-4578-af4a-c6068e16fb1a tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:02.024117 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f0e3c13b-5d7c-4578-af4a-c6068e16fb1a tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:02.024558 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f0e3c13b-5d7c-4578-af4a-c6068e16fb1a tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:02.025333 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f0e3c13b-5d7c-4578-af4a-c6068e16fb1a tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:02.026282 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f0e3c13b-5d7c-4578-af4a-c6068e16fb1a tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:02.202112 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f0e3c13b-5d7c-4578-af4a-c6068e16fb1a tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:02.212190 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f0e3c13b-5d7c-4578-af4a-c6068e16fb1a tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1574 microversion: 2.1 time: 0.202147 Jul 20 08:35:02.212829 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 526/1040] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:02 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1574 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:03.238855 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d5bde779-febe-4911-b223-5194e798abd2 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:03.239529 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d5bde779-febe-4911-b223-5194e798abd2 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:03.248972 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d5bde779-febe-4911-b223-5194e798abd2 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:03.249769 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d5bde779-febe-4911-b223-5194e798abd2 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:03.251168 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d5bde779-febe-4911-b223-5194e798abd2 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:03.251938 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d5bde779-febe-4911-b223-5194e798abd2 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:03.419234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d5bde779-febe-4911-b223-5194e798abd2 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:03.428638 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d5bde779-febe-4911-b223-5194e798abd2 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1574 microversion: 2.1 time: 0.196059 Jul 20 08:35:03.429637 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 515/1041] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:03 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1574 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:04.454482 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3cf1ac26-c18e-411f-8720-ed4039173b0b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:04.455212 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-3cf1ac26-c18e-411f-8720-ed4039173b0b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:04.458735 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=52 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:35:04.462621 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3cf1ac26-c18e-411f-8720-ed4039173b0b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:04.463091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3cf1ac26-c18e-411f-8720-ed4039173b0b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:04.463851 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3cf1ac26-c18e-411f-8720-ed4039173b0b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:04.464887 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3cf1ac26-c18e-411f-8720-ed4039173b0b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:04.565632 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-45c2faea-21d7-4dea-a475-138bd6466adc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:04.566594 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-45c2faea-21d7-4dea-a475-138bd6466adc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:04.574822 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-45c2faea-21d7-4dea-a475-138bd6466adc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:04.575286 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-45c2faea-21d7-4dea-a475-138bd6466adc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:04.576075 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-45c2faea-21d7-4dea-a475-138bd6466adc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:04.576510 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-45c2faea-21d7-4dea-a475-138bd6466adc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:04.609777 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3cf1ac26-c18e-411f-8720-ed4039173b0b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:04.618506 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-3cf1ac26-c18e-411f-8720-ed4039173b0b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1574 microversion: 2.1 time: 0.168109 Jul 20 08:35:04.620033 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 527/1042] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:04 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:04.643946 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-45c2faea-21d7-4dea-a475-138bd6466adc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082208 Jul 20 08:35:04.644510 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 516/1043] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Jul 20 08:35:04 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 08:35:04.708211 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-bbf69c44-4198-4423-b8cb-382bc2ecec7f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:04.708701 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-bbf69c44-4198-4423-b8cb-382bc2ecec7f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:04.715004 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bbf69c44-4198-4423-b8cb-382bc2ecec7f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:04.715450 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bbf69c44-4198-4423-b8cb-382bc2ecec7f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:04.716243 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bbf69c44-4198-4423-b8cb-382bc2ecec7f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:04.716679 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bbf69c44-4198-4423-b8cb-382bc2ecec7f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:04.741789 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-bbf69c44-4198-4423-b8cb-382bc2ecec7f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Going to try to terminate instance {{(pid=117828) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:35:04.794362 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:35:04.827852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-bbf69c44-4198-4423-b8cb-382bc2ecec7f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 204 len: 0 microversion: 2.1 time: 0.123636 Jul 20 08:35:04.828725 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 528/1044] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:35:04 2022] DELETE /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:35:04.836892 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-1dfef8ab-3e89-4af3-96cc-391bd3c67292 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:04.837634 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-1dfef8ab-3e89-4af3-96cc-391bd3c67292 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:04.844739 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1dfef8ab-3e89-4af3-96cc-391bd3c67292 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:04.845115 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1dfef8ab-3e89-4af3-96cc-391bd3c67292 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:04.845897 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1dfef8ab-3e89-4af3-96cc-391bd3c67292 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:04.846337 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1dfef8ab-3e89-4af3-96cc-391bd3c67292 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:04.991350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1dfef8ab-3e89-4af3-96cc-391bd3c67292 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:05.000189 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-1dfef8ab-3e89-4af3-96cc-391bd3c67292 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1673 microversion: 2.1 time: 0.167028 Jul 20 08:35:05.000785 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 517/1045] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:04 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:05.636633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8feed03a-5227-4d16-972a-9991721b08eb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:05.638044 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8feed03a-5227-4d16-972a-9991721b08eb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:05.644866 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8feed03a-5227-4d16-972a-9991721b08eb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:05.645306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8feed03a-5227-4d16-972a-9991721b08eb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:05.646065 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8feed03a-5227-4d16-972a-9991721b08eb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:05.646492 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8feed03a-5227-4d16-972a-9991721b08eb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:05.782824 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-8feed03a-5227-4d16-972a-9991721b08eb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:05.790203 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8feed03a-5227-4d16-972a-9991721b08eb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1574 microversion: 2.1 time: 0.157840 Jul 20 08:35:05.790802 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 529/1046] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:05 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:06.018871 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-319c488a-3ab3-4ee7-a0f5-19ad7db4197a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:06.019395 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-319c488a-3ab3-4ee7-a0f5-19ad7db4197a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:06.026193 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-319c488a-3ab3-4ee7-a0f5-19ad7db4197a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:06.026838 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-319c488a-3ab3-4ee7-a0f5-19ad7db4197a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:06.027847 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-319c488a-3ab3-4ee7-a0f5-19ad7db4197a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:06.028261 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-319c488a-3ab3-4ee7-a0f5-19ad7db4197a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:06.157746 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-319c488a-3ab3-4ee7-a0f5-19ad7db4197a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:06.165243 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-319c488a-3ab3-4ee7-a0f5-19ad7db4197a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1673 microversion: 2.1 time: 0.150487 Jul 20 08:35:06.165815 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 518/1047] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:06 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:06.807229 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-06318743-3115-4e6a-ac7a-d6c8d05c22bb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:06.807874 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-06318743-3115-4e6a-ac7a-d6c8d05c22bb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:06.814444 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-06318743-3115-4e6a-ac7a-d6c8d05c22bb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:06.814932 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-06318743-3115-4e6a-ac7a-d6c8d05c22bb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:06.815763 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-06318743-3115-4e6a-ac7a-d6c8d05c22bb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:06.816207 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-06318743-3115-4e6a-ac7a-d6c8d05c22bb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:06.963231 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-06318743-3115-4e6a-ac7a-d6c8d05c22bb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:06.972189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-06318743-3115-4e6a-ac7a-d6c8d05c22bb tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1574 microversion: 2.1 time: 0.168772 Jul 20 08:35:06.973004 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 530/1048] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:06 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:07.183630 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d83a01f4-7630-4b9c-a711-5143ff38868e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:07.184386 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d83a01f4-7630-4b9c-a711-5143ff38868e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:07.190978 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d83a01f4-7630-4b9c-a711-5143ff38868e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:07.191429 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d83a01f4-7630-4b9c-a711-5143ff38868e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:07.192216 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d83a01f4-7630-4b9c-a711-5143ff38868e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:07.193204 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d83a01f4-7630-4b9c-a711-5143ff38868e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:07.269839 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d83a01f4-7630-4b9c-a711-5143ff38868e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:07.279734 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d83a01f4-7630-4b9c-a711-5143ff38868e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1606 microversion: 2.1 time: 0.100201 Jul 20 08:35:07.280690 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 519/1049] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:07 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1606 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:07.470739 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-9dbabd81-0c13-4dbc-b4a0-a944cc692b4c req-4f0c8dba-3ec6-4abd-82b5-41e170f43578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c374291c-87f7-45dd-9391-807207d937bc", "name": "network-vif-deleted", "tag": "90d4b267-6b9e-479b-978c-9e4434caa2b0"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:35:07.483046 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-9dbabd81-0c13-4dbc-b4a0-a944cc692b4c req-4f0c8dba-3ec6-4abd-82b5-41e170f43578 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:07.483489 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-9dbabd81-0c13-4dbc-b4a0-a944cc692b4c req-4f0c8dba-3ec6-4abd-82b5-41e170f43578 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:07.512232 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-9dbabd81-0c13-4dbc-b4a0-a944cc692b4c req-4f0c8dba-3ec6-4abd-82b5-41e170f43578 service nova] Creating event network-vif-deleted:90d4b267-6b9e-479b-978c-9e4434caa2b0 for instance c374291c-87f7-45dd-9391-807207d937bc on hv-cinder-82308 Jul 20 08:35:07.519769 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-9dbabd81-0c13-4dbc-b4a0-a944cc692b4c req-4f0c8dba-3ec6-4abd-82b5-41e170f43578 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056066 Jul 20 08:35:07.520928 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 531/1050] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:35:07.993632 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e2b3013d-c32d-4e83-886e-d62e2cd1aea7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:07.994805 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e2b3013d-c32d-4e83-886e-d62e2cd1aea7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:08.003636 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e2b3013d-c32d-4e83-886e-d62e2cd1aea7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:08.004085 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e2b3013d-c32d-4e83-886e-d62e2cd1aea7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:08.005009 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e2b3013d-c32d-4e83-886e-d62e2cd1aea7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:08.005633 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e2b3013d-c32d-4e83-886e-d62e2cd1aea7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:08.155330 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e2b3013d-c32d-4e83-886e-d62e2cd1aea7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:08.163228 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e2b3013d-c32d-4e83-886e-d62e2cd1aea7 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1574 microversion: 2.1 time: 0.176737 Jul 20 08:35:08.163690 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 520/1051] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:07 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:08.299256 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8c593c9e-743b-47a1-a4eb-0c5a69bd90ad tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:08.300120 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8c593c9e-743b-47a1-a4eb-0c5a69bd90ad tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:08.307153 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8c593c9e-743b-47a1-a4eb-0c5a69bd90ad tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:08.307600 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8c593c9e-743b-47a1-a4eb-0c5a69bd90ad tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:08.309083 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8c593c9e-743b-47a1-a4eb-0c5a69bd90ad tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:08.309724 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8c593c9e-743b-47a1-a4eb-0c5a69bd90ad tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:08.343701 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8c593c9e-743b-47a1-a4eb-0c5a69bd90ad tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:08.344153 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8c593c9e-743b-47a1-a4eb-0c5a69bd90ad tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:08.344610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.objects.instance [None req-8c593c9e-743b-47a1-a4eb-0c5a69bd90ad tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lazy-loading 'fault' on Instance uuid c374291c-87f7-45dd-9391-807207d937bc {{(pid=117828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:35:08.398258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-8c593c9e-743b-47a1-a4eb-0c5a69bd90ad tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:08.407001 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8c593c9e-743b-47a1-a4eb-0c5a69bd90ad tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1327 microversion: 2.1 time: 0.112414 Jul 20 08:35:08.407597 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 532/1052] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:08 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1327 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:09.179830 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4b3d4160-89b7-4fc6-a9dd-d852b29611e3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:09.180515 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4b3d4160-89b7-4fc6-a9dd-d852b29611e3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:09.188391 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4b3d4160-89b7-4fc6-a9dd-d852b29611e3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:09.188934 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4b3d4160-89b7-4fc6-a9dd-d852b29611e3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:09.189709 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4b3d4160-89b7-4fc6-a9dd-d852b29611e3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:09.190227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4b3d4160-89b7-4fc6-a9dd-d852b29611e3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:09.352018 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4b3d4160-89b7-4fc6-a9dd-d852b29611e3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:09.357534 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:35:09.362758 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4b3d4160-89b7-4fc6-a9dd-d852b29611e3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1574 microversion: 2.1 time: 0.186827 Jul 20 08:35:09.363344 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 521/1053] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:09 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1574 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:09.427220 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8e1f1fc1-69fd-4d22-9013-8e97f99174bb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:09.428081 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8e1f1fc1-69fd-4d22-9013-8e97f99174bb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:09.437572 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8e1f1fc1-69fd-4d22-9013-8e97f99174bb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:09.438117 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8e1f1fc1-69fd-4d22-9013-8e97f99174bb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:09.439336 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8e1f1fc1-69fd-4d22-9013-8e97f99174bb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:09.439982 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8e1f1fc1-69fd-4d22-9013-8e97f99174bb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:09.475391 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8e1f1fc1-69fd-4d22-9013-8e97f99174bb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:09.475845 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8e1f1fc1-69fd-4d22-9013-8e97f99174bb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:09.476299 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.objects.instance [None req-8e1f1fc1-69fd-4d22-9013-8e97f99174bb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lazy-loading 'fault' on Instance uuid c374291c-87f7-45dd-9391-807207d937bc {{(pid=117828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:35:09.525116 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-8e1f1fc1-69fd-4d22-9013-8e97f99174bb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:09.534146 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8e1f1fc1-69fd-4d22-9013-8e97f99174bb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 200 len: 1327 microversion: 2.1 time: 0.112762 Jul 20 08:35:09.534775 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 533/1054] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:09 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 1327 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:10.380589 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4ab29e04-cf1e-4f45-86bd-acd47bd25368 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:10.381208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4ab29e04-cf1e-4f45-86bd-acd47bd25368 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:10.384043 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=44 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:35:10.390009 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4ab29e04-cf1e-4f45-86bd-acd47bd25368 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:10.390469 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4ab29e04-cf1e-4f45-86bd-acd47bd25368 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:10.391296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4ab29e04-cf1e-4f45-86bd-acd47bd25368 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:10.391732 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4ab29e04-cf1e-4f45-86bd-acd47bd25368 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:10.552811 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9d23c041-6079-4043-ba4a-273bafc3aa3c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:10.553847 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9d23c041-6079-4043-ba4a-273bafc3aa3c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:10.562553 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9d23c041-6079-4043-ba4a-273bafc3aa3c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:10.563572 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9d23c041-6079-4043-ba4a-273bafc3aa3c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:10.564480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9d23c041-6079-4043-ba4a-273bafc3aa3c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:10.565019 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9d23c041-6079-4043-ba4a-273bafc3aa3c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:10.582893 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-9d23c041-6079-4043-ba4a-273bafc3aa3c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] HTTP exception thrown: Instance c374291c-87f7-45dd-9391-807207d937bc could not be found. Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9d23c041-6079-4043-ba4a-273bafc3aa3c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Request method failure captured: Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc HTTP/1.1 Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wo_BrUuwgwkV5wSxfZ0PaEG2smOS_3EaSmbvX4GHgTNQJGFIGXS1ZXUvj4vWqiSJpk8D_ha_FxABCakdU3k6UT4ptF0CTt99RQTgVHLBXvgUDjNWjGe3Q-hDMJHG9ykhPcUSN7CLIpMh7HYSIJjlzKs1-rXREybKGWkkYUQQHIgYM Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: fa4764ea3c4f4bf98ea56ee0798adfdc Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-AttachVolumeTestJSON-1815855654 Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:35:10.584630 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:35:10.587767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fa4764ea3c4f4bf98ea56ee0798adfdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fa4764ea3c4f4bf98ea56ee0798adfdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fa4764ea3c4f4bf98ea56ee0798adfdc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fa4764ea3c4f4bf98ea56ee0798adfdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:35:10.587767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-AttachVolumeTestJSON-1815855654 Jul 20 08:35:10.587767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: fa4764ea3c4f4bf98ea56ee0798adfdc Jul 20 08:35:10.587767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1815855654 Jul 20 08:35:10.587767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-AttachVolumeTestJSON-1815855654-project Jul 20 08:35:10.587767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:35:10.587767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:35:10.587767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: b2326ff15f294e15806d8a564770b35e Jul 20 08:35:10.587767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-AttachVolumeTestJSON-1815855654-project Jul 20 08:35:10.587767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:35:10.587767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance c374291c-87f7-45dd-9391-807207d937bc could not be found. Jul 20 08:35:10.587767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': 'c374291c-87f7-45dd-9391-807207d937bc'} Jul 20 08:35:10.590308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:35:10.590308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:35:10.590308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:35:10.590308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:35:10.590308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:35:10.590308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:35:10.590308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:35:10.590308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:35:10.590308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:35:10.590308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:35:10.590308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c374291c-87f7-45dd-9391-807207d937bc could not be found. Jul 20 08:35:10.590308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:35:10.590308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:35:10.590308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:35:10.590308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:35:10.590308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:35:10.590308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:35:10.590308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:35:10.590308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:35:10.590308 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:35:10.597952 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:35:10.597952 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:35:10.597952 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:35:10.597952 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:35:10.597952 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:35:10.597952 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:35:10.597952 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:35:10.597952 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c374291c-87f7-45dd-9391-807207d937bc could not be found. Jul 20 08:35:10.597952 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:35:10.597952 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:35:10.597952 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:35:10.597952 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:35:10.597952 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:35:10.597952 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:35:10.597952 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:35:10.597952 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:35:10.597952 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c374291c-87f7-45dd-9391-807207d937bc could not be found. Jul 20 08:35:10.597952 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:35:10.604373 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9d23c041-6079-4043-ba4a-273bafc3aa3c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Returning 404 to user: Instance c374291c-87f7-45dd-9391-807207d937bc could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:35:10.604373 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9d23c041-6079-4043-ba4a-273bafc3aa3c tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 404 len: 111 microversion: 2.1 time: 0.038245 Jul 20 08:35:10.604373 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 534/1055] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:10 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 08:35:10.604373 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-dc24da4d-cc52-4612-a562-78dfd094d1d7 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '.version_select at 0x7fe3996769d0>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:10.605355 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4ab29e04-cf1e-4f45-86bd-acd47bd25368 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:10.619895 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-dc24da4d-cc52-4612-a562-78dfd094d1d7 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-543427259" status: 202 len: 0 microversion: 2.1 time: 0.025856 Jul 20 08:35:10.620537 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 535/1056] 10.222.0.64 () {58 vars in 1217 bytes} [Wed Jul 20 08:35:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-543427259 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:35:10.622541 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4ab29e04-cf1e-4f45-86bd-acd47bd25368 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1574 microversion: 2.1 time: 0.245885 Jul 20 08:35:10.623344 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 522/1057] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:10 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1574 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:11.443265 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e649255b-af25-495f-983b-019ee007e3dd tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Action: 'create', calling method: .version_select at 0x7fe3996b0ee0>, body: {"keypair": {"name": "tempest-keypair-643525426", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFql0YJhrwyHwbM9gsjpY37e5VNh/516/w5Z77ps3MDr6D9mDZC3IDub2rFjnttz6ZciVfA5yt+XejyaLp87WwovTr1/Im4chdDCcldA/yk4TLDnSvKqJfN9AAEyigoa/Q=="}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:35:11.461815 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-e649255b-af25-495f-983b-019ee007e3dd tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Getting quotas for project fa4764ea3c4f4bf98ea56ee0798adfdc. Resources: {'key_pairs'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:35:11.469033 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-e649255b-af25-495f-983b-019ee007e3dd tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Getting quotas for user b2326ff15f294e15806d8a564770b35e and project fa4764ea3c4f4bf98ea56ee0798adfdc. Resources: {'key_pairs'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:35:11.506305 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e649255b-af25-495f-983b-019ee007e3dd tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.067075 Jul 20 08:35:11.507011 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 536/1058] 10.222.0.64 () {60 vars in 1158 bytes} [Wed Jul 20 08:35:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:35:11.642282 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-487c029c-b3b6-458f-a218-5977aff0c7d5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:11.642918 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-487c029c-b3b6-458f-a218-5977aff0c7d5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:11.649593 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-487c029c-b3b6-458f-a218-5977aff0c7d5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:11.650045 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-487c029c-b3b6-458f-a218-5977aff0c7d5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:11.650863 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-487c029c-b3b6-458f-a218-5977aff0c7d5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:11.651321 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-487c029c-b3b6-458f-a218-5977aff0c7d5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:11.871038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-487c029c-b3b6-458f-a218-5977aff0c7d5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:11.879194 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-487c029c-b3b6-458f-a218-5977aff0c7d5 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1574 microversion: 2.1 time: 0.241232 Jul 20 08:35:11.880056 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 523/1059] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:11 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1574 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:35:12.900861 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-28bf621f-79fb-4036-b944-5d790f6e6abe tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:12.902426 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-28bf621f-79fb-4036-b944-5d790f6e6abe tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:12.910780 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-28bf621f-79fb-4036-b944-5d790f6e6abe tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:12.911235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-28bf621f-79fb-4036-b944-5d790f6e6abe tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:12.912221 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-28bf621f-79fb-4036-b944-5d790f6e6abe tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:12.912834 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-28bf621f-79fb-4036-b944-5d790f6e6abe tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:13.140613 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-28bf621f-79fb-4036-b944-5d790f6e6abe tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:13.149052 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-28bf621f-79fb-4036-b944-5d790f6e6abe tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1561 microversion: 2.1 time: 0.252595 Jul 20 08:35:13.149840 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 537/1060] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:12 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1561 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:35:13.233922 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f60fe4cf-7a35-4ad9-9fbc-855b1b9ff946 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-394984697", "imageRef": "5d6b971e-8afe-4e4a-b054-20cd61970c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "00a5ba6c-be0d-47a8-912c-f2b61f6abcd5"}], "security_groups": [{"name": "tempest-securitygroup--1398306444"}], "key_name": "tempest-keypair-643525426", "user_data": "}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:35:13.336541 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.network.neutron [None req-f60fe4cf-7a35-4ad9-9fbc-855b1b9ff946 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] validate_networks() for [('00a5ba6c-be0d-47a8-912c-f2b61f6abcd5', None, None, None, None, None)] {{(pid=117829) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:35:13.725391 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-f60fe4cf-7a35-4ad9-9fbc-855b1b9ff946 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Flavor limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:35:13.725991 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-f60fe4cf-7a35-4ad9-9fbc-855b1b9ff946 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Image limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:35:13.726678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-f60fe4cf-7a35-4ad9-9fbc-855b1b9ff946 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Flavor pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:35:13.727278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-f60fe4cf-7a35-4ad9-9fbc-855b1b9ff946 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Image pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:35:13.727841 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-f60fe4cf-7a35-4ad9-9fbc-855b1b9ff946 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:35:13.738075 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f60fe4cf-7a35-4ad9-9fbc-855b1b9ff946 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:13.738527 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f60fe4cf-7a35-4ad9-9fbc-855b1b9ff946 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:13.739361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f60fe4cf-7a35-4ad9-9fbc-855b1b9ff946 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:13.739797 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f60fe4cf-7a35-4ad9-9fbc-855b1b9ff946 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:13.757284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-f60fe4cf-7a35-4ad9-9fbc-855b1b9ff946 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Getting quotas for project fa4764ea3c4f4bf98ea56ee0798adfdc. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:35:13.761864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-f60fe4cf-7a35-4ad9-9fbc-855b1b9ff946 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Getting quotas for user b2326ff15f294e15806d8a564770b35e and project fa4764ea3c4f4bf98ea56ee0798adfdc. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:35:13.774052 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f60fe4cf-7a35-4ad9-9fbc-855b1b9ff946 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Going to run 1 instances... {{(pid=117829) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:35:13.777386 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f60fe4cf-7a35-4ad9-9fbc-855b1b9ff946 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d6b971e-8afe-4e4a-b054-20cd61970c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117829) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:35:13.826557 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f60fe4cf-7a35-4ad9-9fbc-855b1b9ff946 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.596906 Jul 20 08:35:13.827436 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 524/1061] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Jul 20 08:35:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 08:35:13.838016 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-17dfc5b7-b925-49a6-94ca-2199e160fa2f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:13.838541 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-17dfc5b7-b925-49a6-94ca-2199e160fa2f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:13.896744 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-17dfc5b7-b925-49a6-94ca-2199e160fa2f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:13.905587 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-17dfc5b7-b925-49a6-94ca-2199e160fa2f tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70" status: 200 len: 1236 microversion: 2.1 time: 0.071597 Jul 20 08:35:13.906562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 538/1062] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:13 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 => generated 1236 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:13.987083 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e4f805ea-a615-4270-b187-e905fef0dca7 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-521191702"}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:35:13.987458 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e4f805ea-a615-4270-b187-e905fef0dca7 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:13.995712 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e4f805ea-a615-4270-b187-e905fef0dca7 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:13.996189 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e4f805ea-a615-4270-b187-e905fef0dca7 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:13.997279 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e4f805ea-a615-4270-b187-e905fef0dca7 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:13.997433 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e4f805ea-a615-4270-b187-e905fef0dca7 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:14.157697 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.network.security_group_api [None req-e4f805ea-a615-4270-b187-e905fef0dca7 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Removing security group a997cc5b-0979-4200-9724-02c22d8b4826 from port 26b6ab63-8e74-43dc-82a1-e3067592fa61 Jul 20 08:35:14.551773 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e4f805ea-a615-4270-b187-e905fef0dca7 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "POST /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de/action" status: 202 len: 0 microversion: 2.1 time: 0.568425 Jul 20 08:35:14.553982 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 525/1063] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Jul 20 08:35:13 2022] POST /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:35:14.566174 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-5a8feb87-807e-4a5f-bbe0-cc1092375209 req-73265a4f-9917-406f-bf5a-46e3b832e6ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a437f068-8b36-411d-ab25-a00ec30b71de", "tag": "26b6ab63-8e74-43dc-82a1-e3067592fa61"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:35:14.586341 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-5a8feb87-807e-4a5f-bbe0-cc1092375209 req-73265a4f-9917-406f-bf5a-46e3b832e6ef service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:14.587819 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-5a8feb87-807e-4a5f-bbe0-cc1092375209 req-73265a4f-9917-406f-bf5a-46e3b832e6ef service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:14.604297 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-5a8feb87-807e-4a5f-bbe0-cc1092375209 req-73265a4f-9917-406f-bf5a-46e3b832e6ef service nova] Creating event network-changed:26b6ab63-8e74-43dc-82a1-e3067592fa61 for instance a437f068-8b36-411d-ab25-a00ec30b71de on hv-cinder-82308 Jul 20 08:35:14.611059 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-5a8feb87-807e-4a5f-bbe0-cc1092375209 req-73265a4f-9917-406f-bf5a-46e3b832e6ef service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050781 Jul 20 08:35:14.617270 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 539/1064] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:35:14.930427 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ec8c1b5e-84d2-43f1-9ac2-0ac469f7bd1e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:14.931381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ec8c1b5e-84d2-43f1-9ac2-0ac469f7bd1e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:14.940138 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ec8c1b5e-84d2-43f1-9ac2-0ac469f7bd1e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:14.940883 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ec8c1b5e-84d2-43f1-9ac2-0ac469f7bd1e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:14.941856 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ec8c1b5e-84d2-43f1-9ac2-0ac469f7bd1e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:14.942459 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ec8c1b5e-84d2-43f1-9ac2-0ac469f7bd1e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:15.160560 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ec8c1b5e-84d2-43f1-9ac2-0ac469f7bd1e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:15.186078 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ec8c1b5e-84d2-43f1-9ac2-0ac469f7bd1e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70" status: 200 len: 1296 microversion: 2.1 time: 0.261149 Jul 20 08:35:15.197928 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 526/1065] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:14 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 => generated 1296 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:15.228854 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-c6614664-65e6-4696-ac9e-51755cd35d08 req-645f7c79-9cec-418f-ac7c-5254b97c4946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e518b913-0606-4cd9-96f7-dfcf59ff8758", "name": "network-vif-plugged", "status": "completed", "tag": "74d72a98-84ae-4d18-bd71-3bf590c0a455"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:35:15.245266 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-c6614664-65e6-4696-ac9e-51755cd35d08 req-645f7c79-9cec-418f-ac7c-5254b97c4946 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:15.245722 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-c6614664-65e6-4696-ac9e-51755cd35d08 req-645f7c79-9cec-418f-ac7c-5254b97c4946 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:15.260406 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-c6614664-65e6-4696-ac9e-51755cd35d08 req-645f7c79-9cec-418f-ac7c-5254b97c4946 service nova] Creating event network-vif-plugged:74d72a98-84ae-4d18-bd71-3bf590c0a455 for instance e518b913-0606-4cd9-96f7-dfcf59ff8758 on hv-cinder-82308 Jul 20 08:35:15.268018 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-c6614664-65e6-4696-ac9e-51755cd35d08 req-645f7c79-9cec-418f-ac7c-5254b97c4946 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043486 Jul 20 08:35:15.269121 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 540/1066] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:35:16.208514 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c497d934-3dea-4d97-b620-ed1f7d3fd362 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:16.209204 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c497d934-3dea-4d97-b620-ed1f7d3fd362 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:16.221744 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c497d934-3dea-4d97-b620-ed1f7d3fd362 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:16.222546 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c497d934-3dea-4d97-b620-ed1f7d3fd362 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:16.223640 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c497d934-3dea-4d97-b620-ed1f7d3fd362 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:16.224240 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c497d934-3dea-4d97-b620-ed1f7d3fd362 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:16.344126 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c497d934-3dea-4d97-b620-ed1f7d3fd362 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:16.352840 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c497d934-3dea-4d97-b620-ed1f7d3fd362 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70" status: 200 len: 1294 microversion: 2.1 time: 0.149823 Jul 20 08:35:16.353808 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 527/1067] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:16 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 => generated 1294 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:17.368803 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-613ff08b-2b86-4a90-99b4-64ae934f208c tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:17.370736 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-613ff08b-2b86-4a90-99b4-64ae934f208c tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:17.371259 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-48100849-d973-4fb7-8692-a6c87c30435a req-cf223c14-8a9a-4aef-a999-0c221daef442 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a437f068-8b36-411d-ab25-a00ec30b71de", "tag": "26b6ab63-8e74-43dc-82a1-e3067592fa61"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:35:17.378782 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-613ff08b-2b86-4a90-99b4-64ae934f208c tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:17.379229 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-613ff08b-2b86-4a90-99b4-64ae934f208c tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:17.380212 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-613ff08b-2b86-4a90-99b4-64ae934f208c tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:17.380647 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-613ff08b-2b86-4a90-99b4-64ae934f208c tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:17.392957 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-48100849-d973-4fb7-8692-a6c87c30435a req-cf223c14-8a9a-4aef-a999-0c221daef442 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:17.393817 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-48100849-d973-4fb7-8692-a6c87c30435a req-cf223c14-8a9a-4aef-a999-0c221daef442 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:17.407402 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-48100849-d973-4fb7-8692-a6c87c30435a req-cf223c14-8a9a-4aef-a999-0c221daef442 service nova] Creating event network-changed:26b6ab63-8e74-43dc-82a1-e3067592fa61 for instance a437f068-8b36-411d-ab25-a00ec30b71de on hv-cinder-82308 Jul 20 08:35:17.413434 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-48100849-d973-4fb7-8692-a6c87c30435a req-cf223c14-8a9a-4aef-a999-0c221daef442 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046867 Jul 20 08:35:17.414756 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 528/1068] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:35:17.426065 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-b0e58bc0-f640-47fa-a20e-c3de97fde351 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:17.427567 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-b0e58bc0-f640-47fa-a20e-c3de97fde351 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:17.438491 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b0e58bc0-f640-47fa-a20e-c3de97fde351 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:17.439085 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b0e58bc0-f640-47fa-a20e-c3de97fde351 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:17.439972 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b0e58bc0-f640-47fa-a20e-c3de97fde351 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:17.440494 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b0e58bc0-f640-47fa-a20e-c3de97fde351 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:17.506436 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.objects.instance [None req-613ff08b-2b86-4a90-99b4-64ae934f208c tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lazy-loading 'services' on Instance uuid a437f068-8b36-411d-ab25-a00ec30b71de {{(pid=117828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:35:17.591091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-613ff08b-2b86-4a90-99b4-64ae934f208c tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de/os-volume_attachments/3b00d1a8-a20d-43d3-815c-5a3b044d96a2" status: 202 len: 0 microversion: 2.1 time: 0.226784 Jul 20 08:35:17.592534 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 541/1069] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Jul 20 08:35:17 2022] DELETE /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de/os-volume_attachments/3b00d1a8-a20d-43d3-815c-5a3b044d96a2 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:35:17.605459 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-2efd9027-2c04-442b-a2b2-70429e477e77 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:17.606879 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-2efd9027-2c04-442b-a2b2-70429e477e77 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:17.623462 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2efd9027-2c04-442b-a2b2-70429e477e77 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:17.624517 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2efd9027-2c04-442b-a2b2-70429e477e77 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:17.625531 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2efd9027-2c04-442b-a2b2-70429e477e77 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:17.626165 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2efd9027-2c04-442b-a2b2-70429e477e77 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:17.671764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-2efd9027-2c04-442b-a2b2-70429e477e77 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072796 Jul 20 08:35:17.677256 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 542/1070] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Jul 20 08:35:17 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:35:17.805407 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b0e58bc0-f640-47fa-a20e-c3de97fde351 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:17.821176 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-b0e58bc0-f640-47fa-a20e-c3de97fde351 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70" status: 200 len: 1362 microversion: 2.1 time: 0.404593 Jul 20 08:35:17.824749 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 529/1071] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:17 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 => generated 1362 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:18.688493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b12cc197-3919-4b0e-a605-69d0f598d0ba tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:18.690552 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b12cc197-3919-4b0e-a605-69d0f598d0ba tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:18.698061 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b12cc197-3919-4b0e-a605-69d0f598d0ba tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:18.699418 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b12cc197-3919-4b0e-a605-69d0f598d0ba tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:18.700519 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b12cc197-3919-4b0e-a605-69d0f598d0ba tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:18.701153 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b12cc197-3919-4b0e-a605-69d0f598d0ba tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:18.752011 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b12cc197-3919-4b0e-a605-69d0f598d0ba tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071003 Jul 20 08:35:18.758711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 543/1072] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Jul 20 08:35:18 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:35:18.842518 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c5e84254-2987-401f-ac4b-f1348054d719 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:18.843214 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c5e84254-2987-401f-ac4b-f1348054d719 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:18.852170 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c5e84254-2987-401f-ac4b-f1348054d719 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:18.853220 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c5e84254-2987-401f-ac4b-f1348054d719 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:18.854944 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c5e84254-2987-401f-ac4b-f1348054d719 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:18.855519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c5e84254-2987-401f-ac4b-f1348054d719 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:19.205672 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c5e84254-2987-401f-ac4b-f1348054d719 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:19.219242 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c5e84254-2987-401f-ac4b-f1348054d719 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70" status: 200 len: 1362 microversion: 2.1 time: 0.380536 Jul 20 08:35:19.220715 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 530/1073] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:18 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:35:19.441615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-8032b962-dab9-45e2-af5c-7feaa910d914 req-73c5b4d6-619a-47de-9016-b568f353bcb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a397563-630d-4bdc-b9e3-5c4b6c5f3d70", "tag": "4ed2e645-2dd2-48a1-af71-1696a608bc20"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:35:19.453488 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-8032b962-dab9-45e2-af5c-7feaa910d914 req-73c5b4d6-619a-47de-9016-b568f353bcb0 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:19.454141 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-8032b962-dab9-45e2-af5c-7feaa910d914 req-73c5b4d6-619a-47de-9016-b568f353bcb0 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:19.468450 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-8032b962-dab9-45e2-af5c-7feaa910d914 req-73c5b4d6-619a-47de-9016-b568f353bcb0 service nova] Creating event network-changed:4ed2e645-2dd2-48a1-af71-1696a608bc20 for instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 on hv-cinder-82308 Jul 20 08:35:19.473846 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-8032b962-dab9-45e2-af5c-7feaa910d914 req-73c5b4d6-619a-47de-9016-b568f353bcb0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037593 Jul 20 08:35:19.475118 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 544/1074] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:35:19.764408 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c1cb170c-3cf9-4a81-a78b-eecbdd8627b3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:19.765498 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c1cb170c-3cf9-4a81-a78b-eecbdd8627b3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:19.771834 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c1cb170c-3cf9-4a81-a78b-eecbdd8627b3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:19.772284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c1cb170c-3cf9-4a81-a78b-eecbdd8627b3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:19.773074 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c1cb170c-3cf9-4a81-a78b-eecbdd8627b3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:19.773504 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c1cb170c-3cf9-4a81-a78b-eecbdd8627b3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:19.817741 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c1cb170c-3cf9-4a81-a78b-eecbdd8627b3 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057620 Jul 20 08:35:19.818335 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 531/1075] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Jul 20 08:35:19 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 08:35:19.831082 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0d0185f5-982d-4108-bde1-4b7735d4209d tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:19.831683 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0d0185f5-982d-4108-bde1-4b7735d4209d tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:19.839567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0d0185f5-982d-4108-bde1-4b7735d4209d tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:19.840279 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0d0185f5-982d-4108-bde1-4b7735d4209d tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:19.841158 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0d0185f5-982d-4108-bde1-4b7735d4209d tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:19.841665 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0d0185f5-982d-4108-bde1-4b7735d4209d tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:19.932053 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-0d0185f5-982d-4108-bde1-4b7735d4209d tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] HTTP exception thrown: Instance a437f068-8b36-411d-ab25-a00ec30b71de is not attached to volume 3b00d1a8-a20d-43d3-815c-5a3b044d96a2 Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0d0185f5-982d-4108-bde1-4b7735d4209d tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Request method failure captured: Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: DELETE /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de/os-volume_attachments/3b00d1a8-a20d-43d3-815c-5a3b044d96a2 HTTP/1.1 Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi170XDDLlDmnNhW6bhB_-scDdtybsBlOVDcMPLT-7D4BIgN93JKSDS1qKBLjJGd7Xe6YQYag82aO9vhgYYPIpcdTZW7GLl56HRbbJNn1EL_Yk4FQ_PNvmmUb841fXTWmmb169vWymttHDFEVTh7GL6v53GStsdiSNHaNY-l3xmi_gKZE Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: 5732783c305f47a389104f7ea5ac5fcf Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-TestMinimumBasicScenario-1159848968 Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:35:19.935055 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:35:19.936815 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5732783c305f47a389104f7ea5ac5fcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5732783c305f47a389104f7ea5ac5fcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5732783c305f47a389104f7ea5ac5fcf", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5732783c305f47a389104f7ea5ac5fcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:35:19.936815 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-TestMinimumBasicScenario-1159848968 Jul 20 08:35:19.936815 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: 5732783c305f47a389104f7ea5ac5fcf Jul 20 08:35:19.936815 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1159848968 Jul 20 08:35:19.936815 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-TestMinimumBasicScenario-1159848968-project Jul 20 08:35:19.936815 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:35:19.936815 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:35:19.936815 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: 482e2d3af7994b6692af6a4fa17dde1d Jul 20 08:35:19.936815 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-TestMinimumBasicScenario-1159848968-project Jul 20 08:35:19.936815 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:35:19.936815 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance a437f068-8b36-411d-ab25-a00ec30b71de is not attached to volume 3b00d1a8-a20d-43d3-815c-5a3b044d96a2 Jul 20 08:35:19.937711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'server_id': 'a437f068-8b36-411d-ab25-a00ec30b71de', 'id': '3b00d1a8-a20d-43d3-815c-5a3b044d96a2'} Jul 20 08:35:19.937711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:35:19.937711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:35:19.937711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 08:35:19.937711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 08:35:19.937711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 08:35:19.937711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 08:35:19.937711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 08:35:19.937711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 08:35:19.937711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3b00d1a8-a20d-43d3-815c-5a3b044d96a2. Jul 20 08:35:19.937711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:35:19.937711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:35:19.937711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:35:19.937711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:35:19.937711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:35:19.937711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:35:19.937711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:35:19.937711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:35:19.937711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:35:19.939224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:35:19.939224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 08:35:19.939224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 08:35:19.939224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a437f068-8b36-411d-ab25-a00ec30b71de is not attached to volume 3b00d1a8-a20d-43d3-815c-5a3b044d96a2 Jul 20 08:35:19.939224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:35:19.939224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:35:19.939224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:35:19.939224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:35:19.939224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:35:19.939224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:35:19.939224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:35:19.939224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:35:19.939224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a437f068-8b36-411d-ab25-a00ec30b71de is not attached to volume 3b00d1a8-a20d-43d3-815c-5a3b044d96a2 Jul 20 08:35:19.939224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:35:19.939224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0d0185f5-982d-4108-bde1-4b7735d4209d tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Returning 404 to user: Instance a437f068-8b36-411d-ab25-a00ec30b71de is not attached to volume 3b00d1a8-a20d-43d3-815c-5a3b044d96a2 {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:35:19.940690 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0d0185f5-982d-4108-bde1-4b7735d4209d tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de/os-volume_attachments/3b00d1a8-a20d-43d3-815c-5a3b044d96a2" status: 404 len: 154 microversion: 2.1 time: 0.111208 Jul 20 08:35:19.940690 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 545/1076] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Jul 20 08:35:19 2022] DELETE /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de/os-volume_attachments/3b00d1a8-a20d-43d3-815c-5a3b044d96a2 => generated 154 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 08:35:20.236342 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a3715f40-8002-4afe-b96e-edbae002f74e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:20.236957 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a3715f40-8002-4afe-b96e-edbae002f74e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:20.243896 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a3715f40-8002-4afe-b96e-edbae002f74e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:20.244391 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a3715f40-8002-4afe-b96e-edbae002f74e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:20.246306 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a3715f40-8002-4afe-b96e-edbae002f74e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:20.246916 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a3715f40-8002-4afe-b96e-edbae002f74e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:20.411320 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a3715f40-8002-4afe-b96e-edbae002f74e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:20.425060 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a3715f40-8002-4afe-b96e-edbae002f74e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70" status: 200 len: 1362 microversion: 2.1 time: 0.192288 Jul 20 08:35:20.426352 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 532/1077] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:20 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:21.103732 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-54f7ecd6-0286-417a-977d-6c336e306b1a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:21.104669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-54f7ecd6-0286-417a-977d-6c336e306b1a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:21.114682 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-54f7ecd6-0286-417a-977d-6c336e306b1a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:21.115148 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-54f7ecd6-0286-417a-977d-6c336e306b1a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:21.115941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-54f7ecd6-0286-417a-977d-6c336e306b1a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:21.116380 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-54f7ecd6-0286-417a-977d-6c336e306b1a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:21.142869 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-54f7ecd6-0286-417a-977d-6c336e306b1a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Going to try to terminate instance {{(pid=117828) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:35:21.224584 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-54f7ecd6-0286-417a-977d-6c336e306b1a tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 204 len: 0 microversion: 2.1 time: 0.127170 Jul 20 08:35:21.225169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 546/1078] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:35:21 2022] DELETE /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:35:21.234120 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-366e5ee7-a365-49ce-a7ed-20c0dd5614af tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:21.235003 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-366e5ee7-a365-49ce-a7ed-20c0dd5614af tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:21.246403 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-366e5ee7-a365-49ce-a7ed-20c0dd5614af tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:21.246403 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-366e5ee7-a365-49ce-a7ed-20c0dd5614af tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:21.246403 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-366e5ee7-a365-49ce-a7ed-20c0dd5614af tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:21.246403 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-366e5ee7-a365-49ce-a7ed-20c0dd5614af tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:21.383691 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-366e5ee7-a365-49ce-a7ed-20c0dd5614af tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:21.392287 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-366e5ee7-a365-49ce-a7ed-20c0dd5614af tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1552 microversion: 2.1 time: 0.162069 Jul 20 08:35:21.392943 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 533/1079] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:21 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:21.446349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-eb0593ed-a42e-4d8e-9854-00be347f574e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:21.447077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-eb0593ed-a42e-4d8e-9854-00be347f574e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:21.454884 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eb0593ed-a42e-4d8e-9854-00be347f574e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:21.455343 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eb0593ed-a42e-4d8e-9854-00be347f574e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:21.456126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eb0593ed-a42e-4d8e-9854-00be347f574e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:21.456571 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eb0593ed-a42e-4d8e-9854-00be347f574e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:21.603117 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-eb0593ed-a42e-4d8e-9854-00be347f574e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:21.611564 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-eb0593ed-a42e-4d8e-9854-00be347f574e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70" status: 200 len: 1362 microversion: 2.1 time: 0.169482 Jul 20 08:35:21.612122 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 547/1080] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:21 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:22.621745 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c619d3c2-5a29-4ade-b4a8-68efca10d115 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:22.622362 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c619d3c2-5a29-4ade-b4a8-68efca10d115 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:22.629090 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c619d3c2-5a29-4ade-b4a8-68efca10d115 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:22.629543 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c619d3c2-5a29-4ade-b4a8-68efca10d115 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:22.630319 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c619d3c2-5a29-4ade-b4a8-68efca10d115 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:22.630478 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-68299a6c-e880-43cf-b249-abc65ef971eb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:22.630987 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c619d3c2-5a29-4ade-b4a8-68efca10d115 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:22.631844 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-68299a6c-e880-43cf-b249-abc65ef971eb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:22.640551 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-68299a6c-e880-43cf-b249-abc65ef971eb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:22.641231 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-68299a6c-e880-43cf-b249-abc65ef971eb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:22.642318 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-68299a6c-e880-43cf-b249-abc65ef971eb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:22.643355 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-68299a6c-e880-43cf-b249-abc65ef971eb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:22.806013 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-68299a6c-e880-43cf-b249-abc65ef971eb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:22.811259 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:35:22.817064 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-68299a6c-e880-43cf-b249-abc65ef971eb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70" status: 200 len: 1362 microversion: 2.1 time: 0.191538 Jul 20 08:35:22.818303 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 548/1081] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:22 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:22.821870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c619d3c2-5a29-4ade-b4a8-68efca10d115 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:22.830456 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c619d3c2-5a29-4ade-b4a8-68efca10d115 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1552 microversion: 2.1 time: 0.423721 Jul 20 08:35:22.831553 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 534/1082] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:22 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1552 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:23.833695 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c8644878-9a74-4279-8686-e9e04cb966ed tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:23.834299 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c8644878-9a74-4279-8686-e9e04cb966ed tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:23.841543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c8644878-9a74-4279-8686-e9e04cb966ed tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:23.843382 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c8644878-9a74-4279-8686-e9e04cb966ed tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:23.843382 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c8644878-9a74-4279-8686-e9e04cb966ed tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:23.843382 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c8644878-9a74-4279-8686-e9e04cb966ed tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:23.849210 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8aa1dfa0-c88a-4d7c-b0bd-93e3de1b26bb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:23.850605 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8aa1dfa0-c88a-4d7c-b0bd-93e3de1b26bb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:23.853633 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=2 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:35:23.854900 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=6 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:35:23.862207 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8aa1dfa0-c88a-4d7c-b0bd-93e3de1b26bb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:23.862693 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8aa1dfa0-c88a-4d7c-b0bd-93e3de1b26bb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:23.863478 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8aa1dfa0-c88a-4d7c-b0bd-93e3de1b26bb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:23.863913 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8aa1dfa0-c88a-4d7c-b0bd-93e3de1b26bb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:23.901615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=6 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:35:24.008766 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c8644878-9a74-4279-8686-e9e04cb966ed tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:24.014495 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8aa1dfa0-c88a-4d7c-b0bd-93e3de1b26bb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:24.021201 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c8644878-9a74-4279-8686-e9e04cb966ed tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70" status: 200 len: 1362 microversion: 2.1 time: 0.191653 Jul 20 08:35:24.021803 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 549/1083] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:23 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:24.023678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8aa1dfa0-c88a-4d7c-b0bd-93e3de1b26bb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1552 microversion: 2.1 time: 0.178853 Jul 20 08:35:24.024264 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 535/1084] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:23 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1552 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:25.044322 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-068f57b0-1dee-436e-b1d0-98576c28c34e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:25.045916 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-068f57b0-1dee-436e-b1d0-98576c28c34e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:25.049725 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f24e5ed0-c844-43ab-99e2-81d0a3e03852 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:25.051184 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f24e5ed0-c844-43ab-99e2-81d0a3e03852 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:25.056860 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-068f57b0-1dee-436e-b1d0-98576c28c34e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:25.057423 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-068f57b0-1dee-436e-b1d0-98576c28c34e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:25.058708 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-068f57b0-1dee-436e-b1d0-98576c28c34e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:25.059374 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-068f57b0-1dee-436e-b1d0-98576c28c34e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:25.069374 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f24e5ed0-c844-43ab-99e2-81d0a3e03852 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:25.070954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f24e5ed0-c844-43ab-99e2-81d0a3e03852 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:25.073953 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f24e5ed0-c844-43ab-99e2-81d0a3e03852 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:25.076250 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f24e5ed0-c844-43ab-99e2-81d0a3e03852 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:25.211618 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-068f57b0-1dee-436e-b1d0-98576c28c34e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:25.224090 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-068f57b0-1dee-436e-b1d0-98576c28c34e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70" status: 200 len: 1362 microversion: 2.1 time: 0.186767 Jul 20 08:35:25.224916 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 550/1085] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:25 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:25.230712 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-863e8377-1863-427b-8a80-ba9791e60253 req-e95295cb-8a39-4d6b-817d-4e33ef728644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a397563-630d-4bdc-b9e3-5c4b6c5f3d70", "name": "network-vif-plugged", "status": "completed", "tag": "4ed2e645-2dd2-48a1-af71-1696a608bc20"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:35:25.239709 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-863e8377-1863-427b-8a80-ba9791e60253 req-e95295cb-8a39-4d6b-817d-4e33ef728644 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:25.240152 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-863e8377-1863-427b-8a80-ba9791e60253 req-e95295cb-8a39-4d6b-817d-4e33ef728644 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:25.252009 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-863e8377-1863-427b-8a80-ba9791e60253 req-e95295cb-8a39-4d6b-817d-4e33ef728644 service nova] Creating event network-vif-plugged:4ed2e645-2dd2-48a1-af71-1696a608bc20 for instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 on hv-cinder-82308 Jul 20 08:35:25.257531 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-863e8377-1863-427b-8a80-ba9791e60253 req-e95295cb-8a39-4d6b-817d-4e33ef728644 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031291 Jul 20 08:35:25.258134 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 551/1086] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:35:25.405240 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f24e5ed0-c844-43ab-99e2-81d0a3e03852 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:25.414477 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f24e5ed0-c844-43ab-99e2-81d0a3e03852 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1552 microversion: 2.1 time: 0.375883 Jul 20 08:35:25.415348 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 536/1087] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:25 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1552 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:25.743384 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-10586158-c851-4100-8164-a353e9cabfe4 req-c909428c-dda9-448f-8886-f591cb6da06b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a437f068-8b36-411d-ab25-a00ec30b71de", "name": "network-vif-deleted", "tag": "26b6ab63-8e74-43dc-82a1-e3067592fa61"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:35:25.754761 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-10586158-c851-4100-8164-a353e9cabfe4 req-c909428c-dda9-448f-8886-f591cb6da06b service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:25.755201 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-10586158-c851-4100-8164-a353e9cabfe4 req-c909428c-dda9-448f-8886-f591cb6da06b service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:25.768413 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-10586158-c851-4100-8164-a353e9cabfe4 req-c909428c-dda9-448f-8886-f591cb6da06b service nova] Creating event network-vif-deleted:26b6ab63-8e74-43dc-82a1-e3067592fa61 for instance a437f068-8b36-411d-ab25-a00ec30b71de on hv-cinder-82308 Jul 20 08:35:25.774138 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-10586158-c851-4100-8164-a353e9cabfe4 req-c909428c-dda9-448f-8886-f591cb6da06b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034946 Jul 20 08:35:25.774763 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 552/1088] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:35:26.090895 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e5f45040-1247-4278-a720-abd4f72da164 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-51690818", "imageRef": "5d6b971e-8afe-4e4a-b054-20cd61970c65", "flavorRef": "452"}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:35:26.146042 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.network.neutron [None req-e5f45040-1247-4278-a720-abd4f72da164 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] validate_networks() for None {{(pid=117829) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:35:26.241820 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-fd260bdf-0667-47de-b18a-c8e57f383f3d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:26.242438 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-fd260bdf-0667-47de-b18a-c8e57f383f3d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:26.250928 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fd260bdf-0667-47de-b18a-c8e57f383f3d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:26.251459 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fd260bdf-0667-47de-b18a-c8e57f383f3d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:26.252393 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fd260bdf-0667-47de-b18a-c8e57f383f3d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:26.252836 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fd260bdf-0667-47de-b18a-c8e57f383f3d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:26.403722 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-fd260bdf-0667-47de-b18a-c8e57f383f3d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:26.411449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-fd260bdf-0667-47de-b18a-c8e57f383f3d tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70" status: 200 len: 1362 microversion: 2.1 time: 0.173775 Jul 20 08:35:26.412017 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 553/1089] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:26 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:35:26.432828 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-359babeb-8a5e-4ac8-9e55-5e93df5e8a32 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:26.433436 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-359babeb-8a5e-4ac8-9e55-5e93df5e8a32 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:26.439921 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-359babeb-8a5e-4ac8-9e55-5e93df5e8a32 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:26.440160 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-e5f45040-1247-4278-a720-abd4f72da164 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Flavor limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:35:26.440375 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-359babeb-8a5e-4ac8-9e55-5e93df5e8a32 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:26.440572 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-e5f45040-1247-4278-a720-abd4f72da164 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Image limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:35:26.441040 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-e5f45040-1247-4278-a720-abd4f72da164 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Flavor pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:35:26.441207 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-359babeb-8a5e-4ac8-9e55-5e93df5e8a32 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:26.441439 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-e5f45040-1247-4278-a720-abd4f72da164 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Image pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:35:26.441569 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-359babeb-8a5e-4ac8-9e55-5e93df5e8a32 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:26.441844 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-e5f45040-1247-4278-a720-abd4f72da164 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:35:26.451843 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e5f45040-1247-4278-a720-abd4f72da164 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:26.452317 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e5f45040-1247-4278-a720-abd4f72da164 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:26.453117 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e5f45040-1247-4278-a720-abd4f72da164 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:26.453544 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e5f45040-1247-4278-a720-abd4f72da164 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:26.470802 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-e5f45040-1247-4278-a720-abd4f72da164 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Getting quotas for project af1fa4326bb34ee08ebc86e605b616c0. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:35:26.473265 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-359babeb-8a5e-4ac8-9e55-5e93df5e8a32 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:26.473719 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-359babeb-8a5e-4ac8-9e55-5e93df5e8a32 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:26.474169 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.objects.instance [None req-359babeb-8a5e-4ac8-9e55-5e93df5e8a32 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lazy-loading 'fault' on Instance uuid a437f068-8b36-411d-ab25-a00ec30b71de {{(pid=117828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:35:26.474752 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-e5f45040-1247-4278-a720-abd4f72da164 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Getting quotas for user e92d365b3be648c3aea8e410fc3dad67 and project af1fa4326bb34ee08ebc86e605b616c0. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:35:26.485924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e5f45040-1247-4278-a720-abd4f72da164 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Going to run 1 instances... {{(pid=117829) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:35:26.488243 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e5f45040-1247-4278-a720-abd4f72da164 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d6b971e-8afe-4e4a-b054-20cd61970c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117829) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:35:26.515739 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-359babeb-8a5e-4ac8-9e55-5e93df5e8a32 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:26.523596 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-359babeb-8a5e-4ac8-9e55-5e93df5e8a32 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1348 microversion: 2.1 time: 0.094746 Jul 20 08:35:26.524177 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 554/1090] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:26 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1348 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:35:26.537092 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e5f45040-1247-4278-a720-abd4f72da164 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.450677 Jul 20 08:35:26.537738 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 537/1091] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Jul 20 08:35:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 08:35:26.548662 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-fa9ccb30-8aa2-438f-87ec-813d68d06759 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:26.549301 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-fa9ccb30-8aa2-438f-87ec-813d68d06759 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:26.602433 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-fa9ccb30-8aa2-438f-87ec-813d68d06759 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92d365b3be648c3aea8e410fc3dad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1fa4326bb34ee08ebc86e605b616c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:26.609417 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-fa9ccb30-8aa2-438f-87ec-813d68d06759 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] 10.222.0.64 "GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a" status: 200 len: 1213 microversion: 2.1 time: 0.065277 Jul 20 08:35:26.609982 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 555/1092] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:26 2022] GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:27.429641 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-bcc01e75-33e7-4633-ab36-590e857bac09 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:27.430312 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-bcc01e75-33e7-4633-ab36-590e857bac09 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:27.437492 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bcc01e75-33e7-4633-ab36-590e857bac09 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:27.437926 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bcc01e75-33e7-4633-ab36-590e857bac09 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:27.438741 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bcc01e75-33e7-4633-ab36-590e857bac09 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:27.439181 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bcc01e75-33e7-4633-ab36-590e857bac09 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:27.541222 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-4b5bdb9b-4af7-46c9-ba09-f7a4a07caecb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:27.542109 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-4b5bdb9b-4af7-46c9-ba09-f7a4a07caecb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:27.548756 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4b5bdb9b-4af7-46c9-ba09-f7a4a07caecb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:27.549198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4b5bdb9b-4af7-46c9-ba09-f7a4a07caecb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:27.549965 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4b5bdb9b-4af7-46c9-ba09-f7a4a07caecb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:27.550429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4b5bdb9b-4af7-46c9-ba09-f7a4a07caecb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:27.571166 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-bcc01e75-33e7-4633-ab36-590e857bac09 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:27.579755 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-bcc01e75-33e7-4633-ab36-590e857bac09 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70" status: 200 len: 1548 microversion: 2.1 time: 0.154846 Jul 20 08:35:27.580687 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 538/1093] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:27 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:27.582818 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4b5bdb9b-4af7-46c9-ba09-f7a4a07caecb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:27.583264 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4b5bdb9b-4af7-46c9-ba09-f7a4a07caecb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:27.583705 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.objects.instance [None req-4b5bdb9b-4af7-46c9-ba09-f7a4a07caecb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lazy-loading 'fault' on Instance uuid a437f068-8b36-411d-ab25-a00ec30b71de {{(pid=117828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:35:27.598451 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d0e96066-bad3-4774-8262-c776020e7f19 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:27.598961 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d0e96066-bad3-4774-8262-c776020e7f19 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:27.605551 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d0e96066-bad3-4774-8262-c776020e7f19 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:27.605997 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d0e96066-bad3-4774-8262-c776020e7f19 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:27.606820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d0e96066-bad3-4774-8262-c776020e7f19 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:27.607228 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d0e96066-bad3-4774-8262-c776020e7f19 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:27.631995 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-4b5bdb9b-4af7-46c9-ba09-f7a4a07caecb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '482e2d3af7994b6692af6a4fa17dde1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5732783c305f47a389104f7ea5ac5fcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:27.641426 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-4b5bdb9b-4af7-46c9-ba09-f7a4a07caecb tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 200 len: 1348 microversion: 2.1 time: 0.104025 Jul 20 08:35:27.642014 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 556/1094] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:27 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 1348 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:35:27.649162 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-12500b09-62b4-4d55-b707-bcc6f7d572c3 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:27.649778 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-12500b09-62b4-4d55-b707-bcc6f7d572c3 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:27.655967 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-12500b09-62b4-4d55-b707-bcc6f7d572c3 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:27.656410 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-12500b09-62b4-4d55-b707-bcc6f7d572c3 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:27.657205 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-12500b09-62b4-4d55-b707-bcc6f7d572c3 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:27.657632 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-12500b09-62b4-4d55-b707-bcc6f7d572c3 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:27.689630 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d0e96066-bad3-4774-8262-c776020e7f19 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095048 Jul 20 08:35:27.690235 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 539/1095] 10.222.0.64 () {58 vars in 1274 bytes} [Wed Jul 20 08:35:27 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:35:27.722381 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-12500b09-62b4-4d55-b707-bcc6f7d572c3 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92d365b3be648c3aea8e410fc3dad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1fa4326bb34ee08ebc86e605b616c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:27.731139 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-12500b09-62b4-4d55-b707-bcc6f7d572c3 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] 10.222.0.64 "GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a" status: 200 len: 1217 microversion: 2.1 time: 0.088063 Jul 20 08:35:27.731727 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 557/1096] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:27 2022] GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:28.658546 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ac1bb1a8-c7aa-467f-81a1-befc86404c72 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:28.659270 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ac1bb1a8-c7aa-467f-81a1-befc86404c72 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] [instance: a437f068-8b36-411d-ab25-a00ec30b71de] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:28.665994 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ac1bb1a8-c7aa-467f-81a1-befc86404c72 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:28.667112 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ac1bb1a8-c7aa-467f-81a1-befc86404c72 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:28.667900 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ac1bb1a8-c7aa-467f-81a1-befc86404c72 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:28.668368 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ac1bb1a8-c7aa-467f-81a1-befc86404c72 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:28.683543 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-ac1bb1a8-c7aa-467f-81a1-befc86404c72 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] HTTP exception thrown: Instance a437f068-8b36-411d-ab25-a00ec30b71de could not be found. Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ac1bb1a8-c7aa-467f-81a1-befc86404c72 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Request method failure captured: Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de HTTP/1.1 Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi170XDDLlDmnNhW6bhB_-scDdtybsBlOVDcMPLT-7D4BIgN93JKSDS1qKBLjJGd7Xe6YQYag82aO9vhgYYPIpcdTZW7GLl56HRbbJNn1EL_Yk4FQ_PNvmmUb841fXTWmmb169vWymttHDFEVTh7GL6v53GStsdiSNHaNY-l3xmi_gKZE Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: 5732783c305f47a389104f7ea5ac5fcf Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-TestMinimumBasicScenario-1159848968 Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:35:28.685227 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:35:28.686945 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5732783c305f47a389104f7ea5ac5fcf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5732783c305f47a389104f7ea5ac5fcf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5732783c305f47a389104f7ea5ac5fcf", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5732783c305f47a389104f7ea5ac5fcf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:35:28.686945 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-TestMinimumBasicScenario-1159848968 Jul 20 08:35:28.686945 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: 5732783c305f47a389104f7ea5ac5fcf Jul 20 08:35:28.686945 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1159848968 Jul 20 08:35:28.686945 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-TestMinimumBasicScenario-1159848968-project Jul 20 08:35:28.686945 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:35:28.686945 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:35:28.686945 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: 482e2d3af7994b6692af6a4fa17dde1d Jul 20 08:35:28.686945 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-TestMinimumBasicScenario-1159848968-project Jul 20 08:35:28.686945 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: > Jul 20 08:35:28.686945 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Instance a437f068-8b36-411d-ab25-a00ec30b71de could not be found. Jul 20 08:35:28.686945 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': 'a437f068-8b36-411d-ab25-a00ec30b71de'} Jul 20 08:35:28.688016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:35:28.688016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:35:28.688016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:35:28.688016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:35:28.688016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:35:28.688016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:35:28.688016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:35:28.688016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:35:28.688016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:35:28.688016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:35:28.688016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a437f068-8b36-411d-ab25-a00ec30b71de could not be found. Jul 20 08:35:28.688016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:35:28.688016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:35:28.688016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:35:28.688016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:35:28.688016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:35:28.688016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:35:28.688016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:35:28.688016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:35:28.688016 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:35:28.689602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:35:28.689602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:35:28.689602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:35:28.689602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:35:28.689602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:35:28.689602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:35:28.689602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:35:28.689602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a437f068-8b36-411d-ab25-a00ec30b71de could not be found. Jul 20 08:35:28.689602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:35:28.689602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:35:28.689602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:35:28.689602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:35:28.689602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:35:28.689602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:35:28.689602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:35:28.689602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:35:28.689602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a437f068-8b36-411d-ab25-a00ec30b71de could not be found. Jul 20 08:35:28.689602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:35:28.691598 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ac1bb1a8-c7aa-467f-81a1-befc86404c72 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Returning 404 to user: Instance a437f068-8b36-411d-ab25-a00ec30b71de could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:35:28.691598 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ac1bb1a8-c7aa-467f-81a1-befc86404c72 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de" status: 404 len: 111 microversion: 2.1 time: 0.032525 Jul 20 08:35:28.691598 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 540/1097] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:28 2022] GET /compute/v2.1/servers/a437f068-8b36-411d-ab25-a00ec30b71de => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 08:35:28.695426 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-714e8307-60f3-42ca-9dbc-9c709a7ce456 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] Calling method '.version_select at 0x7fe3995d11f0>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:28.707012 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:35:28.714350 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-714e8307-60f3-42ca-9dbc-9c709a7ce456 tempest-TestMinimumBasicScenario-1159848968 tempest-TestMinimumBasicScenario-1159848968-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-107838149" status: 202 len: 0 microversion: 2.1 time: 0.022715 Jul 20 08:35:28.718323 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 558/1098] 10.222.0.64 () {58 vars in 1268 bytes} [Wed Jul 20 08:35:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-107838149 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:35:28.749519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-1b0d660b-e33b-41d5-9555-2cad9ff4a7d2 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:28.750862 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-1b0d660b-e33b-41d5-9555-2cad9ff4a7d2 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:28.757331 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1b0d660b-e33b-41d5-9555-2cad9ff4a7d2 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:28.757974 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1b0d660b-e33b-41d5-9555-2cad9ff4a7d2 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:28.758937 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1b0d660b-e33b-41d5-9555-2cad9ff4a7d2 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:28.759590 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1b0d660b-e33b-41d5-9555-2cad9ff4a7d2 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:28.888602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1b0d660b-e33b-41d5-9555-2cad9ff4a7d2 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92d365b3be648c3aea8e410fc3dad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1fa4326bb34ee08ebc86e605b616c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:28.895155 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:35:28.899031 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-1b0d660b-e33b-41d5-9555-2cad9ff4a7d2 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] 10.222.0.64 "GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a" status: 200 len: 1271 microversion: 2.1 time: 0.154343 Jul 20 08:35:28.902956 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 541/1099] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:28 2022] GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:29.207187 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-8fe2a6ea-1886-4c77-b8ff-20db841f2514 req-792f47cd-7153-4c2b-af86-1d2a4b7ed3dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a397563-630d-4bdc-b9e3-5c4b6c5f3d70", "tag": "4ed2e645-2dd2-48a1-af71-1696a608bc20"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:35:29.219048 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-8fe2a6ea-1886-4c77-b8ff-20db841f2514 req-792f47cd-7153-4c2b-af86-1d2a4b7ed3dd service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:29.219589 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-8fe2a6ea-1886-4c77-b8ff-20db841f2514 req-792f47cd-7153-4c2b-af86-1d2a4b7ed3dd service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:29.233938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-8fe2a6ea-1886-4c77-b8ff-20db841f2514 req-792f47cd-7153-4c2b-af86-1d2a4b7ed3dd service nova] Creating event network-changed:4ed2e645-2dd2-48a1-af71-1696a608bc20 for instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 on hv-cinder-82308 Jul 20 08:35:29.239392 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-8fe2a6ea-1886-4c77-b8ff-20db841f2514 req-792f47cd-7153-4c2b-af86-1d2a4b7ed3dd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038884 Jul 20 08:35:29.239994 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 559/1100] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:35:29.917880 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ed3150c1-62d5-400a-8837-3748fd51c86e tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:29.919219 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ed3150c1-62d5-400a-8837-3748fd51c86e tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:29.926619 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ed3150c1-62d5-400a-8837-3748fd51c86e tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:29.927335 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ed3150c1-62d5-400a-8837-3748fd51c86e tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:29.928293 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ed3150c1-62d5-400a-8837-3748fd51c86e tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:29.929490 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ed3150c1-62d5-400a-8837-3748fd51c86e tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:30.035500 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ed3150c1-62d5-400a-8837-3748fd51c86e tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92d365b3be648c3aea8e410fc3dad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1fa4326bb34ee08ebc86e605b616c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:30.047897 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ed3150c1-62d5-400a-8837-3748fd51c86e tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] 10.222.0.64 "GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a" status: 200 len: 1271 microversion: 2.1 time: 0.134968 Jul 20 08:35:30.050607 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 542/1101] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:29 2022] GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a => generated 1271 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:31.067887 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-85ecb706-547e-42ee-b791-80543769f89a tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:31.068592 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-85ecb706-547e-42ee-b791-80543769f89a tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:31.075884 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-85ecb706-547e-42ee-b791-80543769f89a tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:31.076559 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-85ecb706-547e-42ee-b791-80543769f89a tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:31.077250 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-85ecb706-547e-42ee-b791-80543769f89a tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:31.077676 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-85ecb706-547e-42ee-b791-80543769f89a tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:31.274487 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-4d5f7638-c403-46eb-9131-663a53efaf9b req-1cfbd40b-1b32-48a7-a9ad-1cbb0eb27ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50b68122-0dc1-4eb1-9a9f-d8bb177b487a", "tag": "06c5d57e-3206-453a-9525-843ef10a265c"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:35:31.287798 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-4d5f7638-c403-46eb-9131-663a53efaf9b req-1cfbd40b-1b32-48a7-a9ad-1cbb0eb27ebe service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:31.288522 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-4d5f7638-c403-46eb-9131-663a53efaf9b req-1cfbd40b-1b32-48a7-a9ad-1cbb0eb27ebe service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:31.315523 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-4d5f7638-c403-46eb-9131-663a53efaf9b req-1cfbd40b-1b32-48a7-a9ad-1cbb0eb27ebe service nova] Creating event network-changed:06c5d57e-3206-453a-9525-843ef10a265c for instance 50b68122-0dc1-4eb1-9a9f-d8bb177b487a on hv-cinder-82308 Jul 20 08:35:31.352382 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-4d5f7638-c403-46eb-9131-663a53efaf9b req-1cfbd40b-1b32-48a7-a9ad-1cbb0eb27ebe service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085180 Jul 20 08:35:31.357661 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 543/1102] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:35:31.363146 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-85ecb706-547e-42ee-b791-80543769f89a tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92d365b3be648c3aea8e410fc3dad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1fa4326bb34ee08ebc86e605b616c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:31.374128 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-85ecb706-547e-42ee-b791-80543769f89a tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] 10.222.0.64 "GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a" status: 200 len: 1313 microversion: 2.1 time: 0.311439 Jul 20 08:35:31.374755 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 560/1103] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:31 2022] GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:32.392307 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9a3cf186-95eb-4ce5-8962-9d9d4b01c831 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:32.393133 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9a3cf186-95eb-4ce5-8962-9d9d4b01c831 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:32.401586 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9a3cf186-95eb-4ce5-8962-9d9d4b01c831 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:32.402609 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9a3cf186-95eb-4ce5-8962-9d9d4b01c831 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:32.403926 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9a3cf186-95eb-4ce5-8962-9d9d4b01c831 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:32.404609 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9a3cf186-95eb-4ce5-8962-9d9d4b01c831 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:32.635935 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9a3cf186-95eb-4ce5-8962-9d9d4b01c831 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92d365b3be648c3aea8e410fc3dad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1fa4326bb34ee08ebc86e605b616c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:32.647332 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9a3cf186-95eb-4ce5-8962-9d9d4b01c831 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] 10.222.0.64 "GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a" status: 200 len: 1313 microversion: 2.1 time: 0.259519 Jul 20 08:35:32.648023 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 544/1104] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:32 2022] GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:33.665454 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-94e8f4e0-6934-4142-ba78-3acb5bd92970 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:33.666808 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-94e8f4e0-6934-4142-ba78-3acb5bd92970 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:33.673936 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-94e8f4e0-6934-4142-ba78-3acb5bd92970 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:33.674381 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-94e8f4e0-6934-4142-ba78-3acb5bd92970 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:33.675283 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-94e8f4e0-6934-4142-ba78-3acb5bd92970 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:33.675717 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-94e8f4e0-6934-4142-ba78-3acb5bd92970 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:33.815460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-94e8f4e0-6934-4142-ba78-3acb5bd92970 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92d365b3be648c3aea8e410fc3dad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1fa4326bb34ee08ebc86e605b616c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:33.823550 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-94e8f4e0-6934-4142-ba78-3acb5bd92970 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] 10.222.0.64 "GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a" status: 200 len: 1313 microversion: 2.1 time: 0.161864 Jul 20 08:35:33.824132 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 561/1105] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:33 2022] GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:34.840819 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-04285ef9-59f9-4e68-a3e7-6d94612459d5 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:34.842126 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-04285ef9-59f9-4e68-a3e7-6d94612459d5 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:34.849716 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-04285ef9-59f9-4e68-a3e7-6d94612459d5 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:34.850168 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-04285ef9-59f9-4e68-a3e7-6d94612459d5 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:34.850979 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-04285ef9-59f9-4e68-a3e7-6d94612459d5 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:34.851418 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-04285ef9-59f9-4e68-a3e7-6d94612459d5 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:35.099661 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-04285ef9-59f9-4e68-a3e7-6d94612459d5 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92d365b3be648c3aea8e410fc3dad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1fa4326bb34ee08ebc86e605b616c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:35.107454 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-04285ef9-59f9-4e68-a3e7-6d94612459d5 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] 10.222.0.64 "GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a" status: 200 len: 1313 microversion: 2.1 time: 0.271015 Jul 20 08:35:35.108036 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 545/1106] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:34 2022] GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:36.124406 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f2de72e1-bfe0-432d-bbf3-25a762b1855d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:36.125068 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f2de72e1-bfe0-432d-bbf3-25a762b1855d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:36.132340 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f2de72e1-bfe0-432d-bbf3-25a762b1855d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:36.132790 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f2de72e1-bfe0-432d-bbf3-25a762b1855d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:36.133567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f2de72e1-bfe0-432d-bbf3-25a762b1855d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:36.134006 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f2de72e1-bfe0-432d-bbf3-25a762b1855d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:36.376856 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f2de72e1-bfe0-432d-bbf3-25a762b1855d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92d365b3be648c3aea8e410fc3dad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1fa4326bb34ee08ebc86e605b616c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:36.384539 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f2de72e1-bfe0-432d-bbf3-25a762b1855d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] 10.222.0.64 "GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a" status: 200 len: 1313 microversion: 2.1 time: 0.263985 Jul 20 08:35:36.385846 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 562/1107] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:36 2022] GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:37.407425 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-38156b38-e3ab-4668-8cd0-0e2da893b9e6 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:37.409801 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-38156b38-e3ab-4668-8cd0-0e2da893b9e6 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:37.415071 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=2 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:35:37.416801 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=6 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:35:37.428919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-38156b38-e3ab-4668-8cd0-0e2da893b9e6 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:37.430648 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-38156b38-e3ab-4668-8cd0-0e2da893b9e6 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:37.433597 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-38156b38-e3ab-4668-8cd0-0e2da893b9e6 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:37.434758 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-38156b38-e3ab-4668-8cd0-0e2da893b9e6 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:37.610434 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-38156b38-e3ab-4668-8cd0-0e2da893b9e6 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92d365b3be648c3aea8e410fc3dad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1fa4326bb34ee08ebc86e605b616c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:37.618477 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-38156b38-e3ab-4668-8cd0-0e2da893b9e6 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] 10.222.0.64 "GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a" status: 200 len: 1313 microversion: 2.1 time: 0.219985 Jul 20 08:35:37.620272 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 546/1108] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:37 2022] GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:38.637597 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1a68b042-d0d5-44c3-98ce-e231361fabe7 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:38.638209 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1a68b042-d0d5-44c3-98ce-e231361fabe7 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:38.640686 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=2 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:35:38.646933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1a68b042-d0d5-44c3-98ce-e231361fabe7 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:38.647411 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1a68b042-d0d5-44c3-98ce-e231361fabe7 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:38.648220 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1a68b042-d0d5-44c3-98ce-e231361fabe7 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:38.648655 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1a68b042-d0d5-44c3-98ce-e231361fabe7 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:38.819068 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1a68b042-d0d5-44c3-98ce-e231361fabe7 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92d365b3be648c3aea8e410fc3dad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1fa4326bb34ee08ebc86e605b616c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:38.828381 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1a68b042-d0d5-44c3-98ce-e231361fabe7 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] 10.222.0.64 "GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a" status: 200 len: 1313 microversion: 2.1 time: 0.194748 Jul 20 08:35:38.829057 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 563/1109] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:38 2022] GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:39.156800 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-c88cc376-7ad8-4e0b-9674-4a0839320567 req-b960f16f-0780-4675-94c9-4fddc815ee7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50b68122-0dc1-4eb1-9a9f-d8bb177b487a", "name": "network-vif-plugged", "status": "completed", "tag": "06c5d57e-3206-453a-9525-843ef10a265c"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:35:39.173186 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-c88cc376-7ad8-4e0b-9674-4a0839320567 req-b960f16f-0780-4675-94c9-4fddc815ee7d service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:39.174014 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-c88cc376-7ad8-4e0b-9674-4a0839320567 req-b960f16f-0780-4675-94c9-4fddc815ee7d service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:39.186235 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-c88cc376-7ad8-4e0b-9674-4a0839320567 req-b960f16f-0780-4675-94c9-4fddc815ee7d service nova] Creating event network-vif-plugged:06c5d57e-3206-453a-9525-843ef10a265c for instance 50b68122-0dc1-4eb1-9a9f-d8bb177b487a on hv-cinder-82308 Jul 20 08:35:39.191641 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-c88cc376-7ad8-4e0b-9674-4a0839320567 req-b960f16f-0780-4675-94c9-4fddc815ee7d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039611 Jul 20 08:35:39.192266 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 547/1110] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:35:39.845686 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-aae3b0ae-8ce6-476c-9179-abda366fe94d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:39.846480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-aae3b0ae-8ce6-476c-9179-abda366fe94d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:39.853878 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aae3b0ae-8ce6-476c-9179-abda366fe94d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:39.854510 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aae3b0ae-8ce6-476c-9179-abda366fe94d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:39.855439 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aae3b0ae-8ce6-476c-9179-abda366fe94d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:39.856103 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aae3b0ae-8ce6-476c-9179-abda366fe94d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:40.008339 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-aae3b0ae-8ce6-476c-9179-abda366fe94d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92d365b3be648c3aea8e410fc3dad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1fa4326bb34ee08ebc86e605b616c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:40.022932 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-aae3b0ae-8ce6-476c-9179-abda366fe94d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] 10.222.0.64 "GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a" status: 200 len: 1313 microversion: 2.1 time: 0.180778 Jul 20 08:35:40.024519 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 564/1111] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:39 2022] GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:41.044546 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-48170b38-0523-46e9-a7cf-64a14f49cf6d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:41.045956 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-48170b38-0523-46e9-a7cf-64a14f49cf6d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:41.049240 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:35:41.060798 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-48170b38-0523-46e9-a7cf-64a14f49cf6d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:41.061593 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-48170b38-0523-46e9-a7cf-64a14f49cf6d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:41.062985 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-48170b38-0523-46e9-a7cf-64a14f49cf6d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:41.063745 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-48170b38-0523-46e9-a7cf-64a14f49cf6d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:41.479669 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-48170b38-0523-46e9-a7cf-64a14f49cf6d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92d365b3be648c3aea8e410fc3dad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1fa4326bb34ee08ebc86e605b616c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:41.487500 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-48170b38-0523-46e9-a7cf-64a14f49cf6d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] 10.222.0.64 "GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a" status: 200 len: 1313 microversion: 2.1 time: 0.450563 Jul 20 08:35:41.488490 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 548/1112] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:41 2022] GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:42.505403 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-88f445c4-0dc3-4f01-b4ba-16817e2344ee tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:42.506099 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-88f445c4-0dc3-4f01-b4ba-16817e2344ee tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:42.513508 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-88f445c4-0dc3-4f01-b4ba-16817e2344ee tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:42.514235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-88f445c4-0dc3-4f01-b4ba-16817e2344ee tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:42.515048 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-88f445c4-0dc3-4f01-b4ba-16817e2344ee tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:42.515489 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-88f445c4-0dc3-4f01-b4ba-16817e2344ee tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:42.731194 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-88f445c4-0dc3-4f01-b4ba-16817e2344ee tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92d365b3be648c3aea8e410fc3dad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1fa4326bb34ee08ebc86e605b616c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:42.740002 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-88f445c4-0dc3-4f01-b4ba-16817e2344ee tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] 10.222.0.64 "GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a" status: 200 len: 1462 microversion: 2.1 time: 0.238587 Jul 20 08:35:42.740593 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 565/1113] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:42 2022] GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a => generated 1462 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:35:42.807105 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ed0b2bb3-ebe6-4b60-8d00-789ac33749eb tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:42.807824 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ed0b2bb3-ebe6-4b60-8d00-789ac33749eb tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:42.816889 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ed0b2bb3-ebe6-4b60-8d00-789ac33749eb tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:42.817803 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ed0b2bb3-ebe6-4b60-8d00-789ac33749eb tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:42.819392 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ed0b2bb3-ebe6-4b60-8d00-789ac33749eb tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:42.820160 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ed0b2bb3-ebe6-4b60-8d00-789ac33749eb tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:42.857672 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ed0b2bb3-ebe6-4b60-8d00-789ac33749eb tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] Going to try to terminate instance {{(pid=117829) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:35:42.970027 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ed0b2bb3-ebe6-4b60-8d00-789ac33749eb tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] 10.222.0.64 "DELETE /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a" status: 204 len: 0 microversion: 2.1 time: 0.167672 Jul 20 08:35:42.970642 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 549/1114] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:35:42 2022] DELETE /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:35:42.982424 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-6dd67676-0c4b-49af-9170-dbb682a35802 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:42.983238 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-6dd67676-0c4b-49af-9170-dbb682a35802 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:42.991461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6dd67676-0c4b-49af-9170-dbb682a35802 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:42.991923 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6dd67676-0c4b-49af-9170-dbb682a35802 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:42.992741 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6dd67676-0c4b-49af-9170-dbb682a35802 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:42.993160 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6dd67676-0c4b-49af-9170-dbb682a35802 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:43.139191 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-6dd67676-0c4b-49af-9170-dbb682a35802 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92d365b3be648c3aea8e410fc3dad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1fa4326bb34ee08ebc86e605b616c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:43.146857 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-6dd67676-0c4b-49af-9170-dbb682a35802 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] 10.222.0.64 "GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a" status: 200 len: 1468 microversion: 2.1 time: 0.170987 Jul 20 08:35:43.147438 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 566/1115] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:42 2022] GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a => generated 1468 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:44.170761 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d849217b-063f-4677-bab8-4b24d49eb89d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:44.171454 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d849217b-063f-4677-bab8-4b24d49eb89d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:44.177765 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d849217b-063f-4677-bab8-4b24d49eb89d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:44.178209 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d849217b-063f-4677-bab8-4b24d49eb89d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:44.179049 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d849217b-063f-4677-bab8-4b24d49eb89d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:44.179485 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d849217b-063f-4677-bab8-4b24d49eb89d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:44.326074 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d849217b-063f-4677-bab8-4b24d49eb89d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92d365b3be648c3aea8e410fc3dad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1fa4326bb34ee08ebc86e605b616c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:44.334230 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d849217b-063f-4677-bab8-4b24d49eb89d tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] 10.222.0.64 "GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a" status: 200 len: 1468 microversion: 2.1 time: 0.168987 Jul 20 08:35:44.334840 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 550/1116] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:44 2022] GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a => generated 1468 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:45.353679 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-881e6009-e615-44ed-b278-03a9c4aab40b tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:45.354499 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-881e6009-e615-44ed-b278-03a9c4aab40b tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:45.361755 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-881e6009-e615-44ed-b278-03a9c4aab40b tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:45.362297 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-881e6009-e615-44ed-b278-03a9c4aab40b tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:45.363161 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-881e6009-e615-44ed-b278-03a9c4aab40b tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:45.363804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-881e6009-e615-44ed-b278-03a9c4aab40b tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:45.474153 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-881e6009-e615-44ed-b278-03a9c4aab40b tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e92d365b3be648c3aea8e410fc3dad67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af1fa4326bb34ee08ebc86e605b616c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:35:45.486003 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-881e6009-e615-44ed-b278-03a9c4aab40b tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] 10.222.0.64 "GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a" status: 200 len: 1426 microversion: 2.1 time: 0.136321 Jul 20 08:35:45.486605 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 567/1117] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:45 2022] GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a => generated 1426 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:35:45.531430 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-072b8711-d6ec-4d4c-aa1e-fbfa76640e78 req-749cc4e3-a467-4540-9256-b31937ed517a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50b68122-0dc1-4eb1-9a9f-d8bb177b487a", "name": "network-vif-deleted", "tag": "06c5d57e-3206-453a-9525-843ef10a265c"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:35:45.542048 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-072b8711-d6ec-4d4c-aa1e-fbfa76640e78 req-749cc4e3-a467-4540-9256-b31937ed517a service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:45.542890 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-072b8711-d6ec-4d4c-aa1e-fbfa76640e78 req-749cc4e3-a467-4540-9256-b31937ed517a service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:45.567105 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-072b8711-d6ec-4d4c-aa1e-fbfa76640e78 req-749cc4e3-a467-4540-9256-b31937ed517a service nova] Creating event network-vif-deleted:06c5d57e-3206-453a-9525-843ef10a265c for instance 50b68122-0dc1-4eb1-9a9f-d8bb177b487a on hv-cinder-82308 Jul 20 08:35:45.573235 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-072b8711-d6ec-4d4c-aa1e-fbfa76640e78 req-749cc4e3-a467-4540-9256-b31937ed517a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052578 Jul 20 08:35:45.574168 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 551/1118] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:35:46.505339 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8a4ccd34-4430-4673-9aef-e4bfc0fc0718 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:35:46.506481 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8a4ccd34-4430-4673-9aef-e4bfc0fc0718 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] [instance: 50b68122-0dc1-4eb1-9a9f-d8bb177b487a] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:35:46.515527 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8a4ccd34-4430-4673-9aef-e4bfc0fc0718 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:46.516348 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8a4ccd34-4430-4673-9aef-e4bfc0fc0718 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:46.517503 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8a4ccd34-4430-4673-9aef-e4bfc0fc0718 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:35:46.518204 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8a4ccd34-4430-4673-9aef-e4bfc0fc0718 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:35:46.535532 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-8a4ccd34-4430-4673-9aef-e4bfc0fc0718 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] HTTP exception thrown: Instance 50b68122-0dc1-4eb1-9a9f-d8bb177b487a could not be found. Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8a4ccd34-4430-4673-9aef-e4bfc0fc0718 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Request method failure captured: Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a HTTP/1.1 Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi175MCQiPubtkVVfCvVLuGngRgSY_bALccHEx4Apknrfhha2m_GawdVBswabsCML153QtfiUHWws-UjLotX_MXjRUSxZKw_FUEk6dCk8qp45ExHucgr_ErobA7yLo3erRfDuW4vi5NaBscnuv6CNoBCsMhHknkzXl55qQLktSF5DXIDE Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: af1fa4326bb34ee08ebc86e605b616c0 Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-VolumesNegativeTest-2080392661 Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:35:46.537183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:35:46.540034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/af1fa4326bb34ee08ebc86e605b616c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/af1fa4326bb34ee08ebc86e605b616c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_af1fa4326bb34ee08ebc86e605b616c0", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/af1fa4326bb34ee08ebc86e605b616c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:35:46.540034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-VolumesNegativeTest-2080392661 Jul 20 08:35:46.540034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: af1fa4326bb34ee08ebc86e605b616c0 Jul 20 08:35:46.540034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-VolumesNegativeTest-2080392661 Jul 20 08:35:46.540034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-VolumesNegativeTest-2080392661-project Jul 20 08:35:46.540034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:35:46.540034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:35:46.540034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: e92d365b3be648c3aea8e410fc3dad67 Jul 20 08:35:46.540034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-VolumesNegativeTest-2080392661-project Jul 20 08:35:46.540034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:35:46.540034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance 50b68122-0dc1-4eb1-9a9f-d8bb177b487a could not be found. Jul 20 08:35:46.540034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': '50b68122-0dc1-4eb1-9a9f-d8bb177b487a'} Jul 20 08:35:46.543091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:35:46.543091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:35:46.543091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:35:46.543091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:35:46.543091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:35:46.543091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:35:46.543091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:35:46.543091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:35:46.543091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:35:46.543091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:35:46.543091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50b68122-0dc1-4eb1-9a9f-d8bb177b487a could not be found. Jul 20 08:35:46.543091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:35:46.543091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:35:46.543091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:35:46.543091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:35:46.543091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:35:46.543091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:35:46.543091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:35:46.543091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:35:46.543091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:35:46.544901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:35:46.544901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:35:46.544901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:35:46.544901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:35:46.544901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:35:46.544901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:35:46.544901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:35:46.544901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50b68122-0dc1-4eb1-9a9f-d8bb177b487a could not be found. Jul 20 08:35:46.544901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:35:46.544901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:35:46.544901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:35:46.544901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:35:46.544901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:35:46.544901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:35:46.544901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:35:46.544901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:35:46.544901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50b68122-0dc1-4eb1-9a9f-d8bb177b487a could not be found. Jul 20 08:35:46.544901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:35:46.546250 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8a4ccd34-4430-4673-9aef-e4bfc0fc0718 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] Returning 404 to user: Instance 50b68122-0dc1-4eb1-9a9f-d8bb177b487a could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:35:46.546250 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8a4ccd34-4430-4673-9aef-e4bfc0fc0718 tempest-VolumesNegativeTest-2080392661 tempest-VolumesNegativeTest-2080392661-project] 10.222.0.64 "GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a" status: 404 len: 111 microversion: 2.1 time: 0.038819 Jul 20 08:35:46.546250 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 568/1119] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:35:46 2022] GET /compute/v2.1/servers/50b68122-0dc1-4eb1-9a9f-d8bb177b487a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:36:11.684444 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 08:36:11.685025 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Wed Jul 20 08:36:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 08:36:20.578714 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:36:20.579515 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:36:20.850371 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d20914f0-5eb4-4588-999e-67bab6ac3135 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:20.851003 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d20914f0-5eb4-4588-999e-67bab6ac3135 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:20.858307 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d20914f0-5eb4-4588-999e-67bab6ac3135 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:20.858781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d20914f0-5eb4-4588-999e-67bab6ac3135 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:20.859572 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d20914f0-5eb4-4588-999e-67bab6ac3135 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:20.860005 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d20914f0-5eb4-4588-999e-67bab6ac3135 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:20.884546 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d20914f0-5eb4-4588-999e-67bab6ac3135 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09/ips" status: 200 len: 153 microversion: 2.20 time: 0.307342 Jul 20 08:36:20.885098 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 552/1120] 10.222.0.64 () {60 vars in 1288 bytes} [Wed Jul 20 08:36:20 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09/ips => generated 153 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 08:36:22.737767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8de962ac-2642-4517-8273-2187395d791b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:36:22.738375 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8de962ac-2642-4517-8273-2187395d791b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:22.740352 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=20 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:36:22.740996 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=96 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:36:22.747076 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8de962ac-2642-4517-8273-2187395d791b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:22.747527 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8de962ac-2642-4517-8273-2187395d791b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:22.748311 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8de962ac-2642-4517-8273-2187395d791b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:22.748740 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8de962ac-2642-4517-8273-2187395d791b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:22.773082 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.objects.instance [None req-8de962ac-2642-4517-8273-2187395d791b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lazy-loading 'flavor' on Instance uuid 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 {{(pid=117828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:36:23.042153 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8de962ac-2642-4517-8273-2187395d791b tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "POST /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09/action" status: 202 len: 0 microversion: 2.20 time: 0.308365 Jul 20 08:36:23.043099 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 569/1121] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Jul 20 08:36:22 2022] POST /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:36:23.051341 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c828aabd-9d93-4df7-b809-512d7e83699a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:23.051931 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c828aabd-9d93-4df7-b809-512d7e83699a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:23.059573 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c828aabd-9d93-4df7-b809-512d7e83699a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:23.060030 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c828aabd-9d93-4df7-b809-512d7e83699a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:23.060816 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c828aabd-9d93-4df7-b809-512d7e83699a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:23.061255 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c828aabd-9d93-4df7-b809-512d7e83699a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:23.200737 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c828aabd-9d93-4df7-b809-512d7e83699a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:23.208828 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c828aabd-9d93-4df7-b809-512d7e83699a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:23.210320 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c828aabd-9d93-4df7-b809-512d7e83699a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:23.211613 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c828aabd-9d93-4df7-b809-512d7e83699a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1725 microversion: 2.20 time: 0.164348 Jul 20 08:36:23.212172 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 553/1122] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:23 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:24.231341 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b3cd3a62-b50f-4d4a-9224-9177bf3599b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:24.232048 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b3cd3a62-b50f-4d4a-9224-9177bf3599b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:24.239032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b3cd3a62-b50f-4d4a-9224-9177bf3599b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:24.239506 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b3cd3a62-b50f-4d4a-9224-9177bf3599b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:24.240267 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b3cd3a62-b50f-4d4a-9224-9177bf3599b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:24.240773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b3cd3a62-b50f-4d4a-9224-9177bf3599b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:24.378691 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b3cd3a62-b50f-4d4a-9224-9177bf3599b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:24.387193 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b3cd3a62-b50f-4d4a-9224-9177bf3599b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:24.388671 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b3cd3a62-b50f-4d4a-9224-9177bf3599b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:24.390086 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b3cd3a62-b50f-4d4a-9224-9177bf3599b2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1725 microversion: 2.20 time: 0.163905 Jul 20 08:36:24.390651 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 570/1123] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:24 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:25.409262 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-fb8ca517-6378-4b95-b863-82538e6607cb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:25.409915 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-fb8ca517-6378-4b95-b863-82538e6607cb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:25.416691 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fb8ca517-6378-4b95-b863-82538e6607cb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:25.417138 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fb8ca517-6378-4b95-b863-82538e6607cb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:25.417909 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fb8ca517-6378-4b95-b863-82538e6607cb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:25.418342 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fb8ca517-6378-4b95-b863-82538e6607cb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:25.551472 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fb8ca517-6378-4b95-b863-82538e6607cb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:25.559915 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fb8ca517-6378-4b95-b863-82538e6607cb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:25.561417 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fb8ca517-6378-4b95-b863-82538e6607cb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:25.562568 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-fb8ca517-6378-4b95-b863-82538e6607cb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1725 microversion: 2.20 time: 0.157260 Jul 20 08:36:25.563150 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 554/1124] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:25 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:26.581183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-11e970e6-acaa-4828-a6d8-e699af980eae tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:26.581784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-11e970e6-acaa-4828-a6d8-e699af980eae tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:26.589282 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-11e970e6-acaa-4828-a6d8-e699af980eae tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:26.589732 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-11e970e6-acaa-4828-a6d8-e699af980eae tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:26.590502 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-11e970e6-acaa-4828-a6d8-e699af980eae tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:26.590963 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-11e970e6-acaa-4828-a6d8-e699af980eae tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:26.733079 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-11e970e6-acaa-4828-a6d8-e699af980eae tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:26.741182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-11e970e6-acaa-4828-a6d8-e699af980eae tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:26.743573 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-11e970e6-acaa-4828-a6d8-e699af980eae tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:26.744744 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-11e970e6-acaa-4828-a6d8-e699af980eae tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1725 microversion: 2.20 time: 0.167884 Jul 20 08:36:26.745302 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 571/1125] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:26 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:27.763529 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e2a69e72-be27-45e3-a7d8-bf7ddbd6521f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:27.764411 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e2a69e72-be27-45e3-a7d8-bf7ddbd6521f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:27.771002 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e2a69e72-be27-45e3-a7d8-bf7ddbd6521f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:27.771451 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e2a69e72-be27-45e3-a7d8-bf7ddbd6521f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:27.772216 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e2a69e72-be27-45e3-a7d8-bf7ddbd6521f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:27.772653 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e2a69e72-be27-45e3-a7d8-bf7ddbd6521f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:27.901045 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e2a69e72-be27-45e3-a7d8-bf7ddbd6521f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:27.909127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e2a69e72-be27-45e3-a7d8-bf7ddbd6521f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:27.910630 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-e2a69e72-be27-45e3-a7d8-bf7ddbd6521f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:27.911785 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e2a69e72-be27-45e3-a7d8-bf7ddbd6521f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1725 microversion: 2.20 time: 0.152217 Jul 20 08:36:27.912337 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 555/1126] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:27 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:28.422084 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a8bb1b92-ad5b-4de6-8766-89e27b57c4b1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:28.422614 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a8bb1b92-ad5b-4de6-8766-89e27b57c4b1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:28.428565 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a8bb1b92-ad5b-4de6-8766-89e27b57c4b1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:28.428999 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a8bb1b92-ad5b-4de6-8766-89e27b57c4b1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:28.429899 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a8bb1b92-ad5b-4de6-8766-89e27b57c4b1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:28.430327 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a8bb1b92-ad5b-4de6-8766-89e27b57c4b1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:28.454758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a8bb1b92-ad5b-4de6-8766-89e27b57c4b1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77/ips" status: 200 len: 148 microversion: 2.1 time: 0.175834 Jul 20 08:36:28.455302 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 572/1127] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Jul 20 08:36:28 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77/ips => generated 148 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:36:28.929959 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-17bf9eff-fffb-4406-9fb5-35b685d13561 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:28.930833 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-17bf9eff-fffb-4406-9fb5-35b685d13561 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:28.937008 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-17bf9eff-fffb-4406-9fb5-35b685d13561 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:28.937466 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-17bf9eff-fffb-4406-9fb5-35b685d13561 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:28.938204 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-17bf9eff-fffb-4406-9fb5-35b685d13561 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:28.938651 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-17bf9eff-fffb-4406-9fb5-35b685d13561 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:29.075461 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-17bf9eff-fffb-4406-9fb5-35b685d13561 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:29.083443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-17bf9eff-fffb-4406-9fb5-35b685d13561 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:29.084955 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-17bf9eff-fffb-4406-9fb5-35b685d13561 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:29.086231 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-17bf9eff-fffb-4406-9fb5-35b685d13561 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1725 microversion: 2.20 time: 0.160661 Jul 20 08:36:29.086871 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 556/1128] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:28 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:29.788669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e9cd6231-49a5-4652-8793-b8b097fe58dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5aaa03d-8044-4545-9d69-d30c32fe846c"}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:36:29.790700 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-e9cd6231-49a5-4652-8793-b8b097fe58dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:29.797299 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e9cd6231-49a5-4652-8793-b8b097fe58dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:29.797745 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e9cd6231-49a5-4652-8793-b8b097fe58dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:29.798512 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e9cd6231-49a5-4652-8793-b8b097fe58dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:29.798970 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e9cd6231-49a5-4652-8793-b8b097fe58dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:30.072244 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e9cd6231-49a5-4652-8793-b8b097fe58dd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "POST /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287484 Jul 20 08:36:30.073080 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 573/1129] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Jul 20 08:36:29 2022] POST /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:36:30.105179 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d50bc1cc-cd1f-47c7-81cc-94ad434854b7 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:30.105568 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d50bc1cc-cd1f-47c7-81cc-94ad434854b7 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:30.113475 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d50bc1cc-cd1f-47c7-81cc-94ad434854b7 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:30.114081 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d50bc1cc-cd1f-47c7-81cc-94ad434854b7 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:30.115112 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d50bc1cc-cd1f-47c7-81cc-94ad434854b7 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:30.116235 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d50bc1cc-cd1f-47c7-81cc-94ad434854b7 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:30.278195 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d50bc1cc-cd1f-47c7-81cc-94ad434854b7 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:30.286553 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d50bc1cc-cd1f-47c7-81cc-94ad434854b7 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:30.288209 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d50bc1cc-cd1f-47c7-81cc-94ad434854b7 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:30.289890 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d50bc1cc-cd1f-47c7-81cc-94ad434854b7 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1725 microversion: 2.20 time: 0.189266 Jul 20 08:36:30.290469 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 557/1130] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:30 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:31.309689 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-2fab955d-50ee-412c-83a8-ab5e9960161f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:31.310384 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-2fab955d-50ee-412c-83a8-ab5e9960161f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:31.316897 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2fab955d-50ee-412c-83a8-ab5e9960161f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:31.317344 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2fab955d-50ee-412c-83a8-ab5e9960161f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:31.318115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2fab955d-50ee-412c-83a8-ab5e9960161f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:31.318552 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2fab955d-50ee-412c-83a8-ab5e9960161f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:31.459700 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2fab955d-50ee-412c-83a8-ab5e9960161f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:31.468086 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2fab955d-50ee-412c-83a8-ab5e9960161f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:31.469590 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2fab955d-50ee-412c-83a8-ab5e9960161f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:31.470780 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-2fab955d-50ee-412c-83a8-ab5e9960161f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1725 microversion: 2.20 time: 0.166371 Jul 20 08:36:31.471350 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 574/1131] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:31 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:32.489673 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-26f0dbde-b388-4f2c-903c-93a31a39d072 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:32.490248 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-26f0dbde-b388-4f2c-903c-93a31a39d072 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:32.497252 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-26f0dbde-b388-4f2c-903c-93a31a39d072 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:32.497695 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-26f0dbde-b388-4f2c-903c-93a31a39d072 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:32.498495 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-26f0dbde-b388-4f2c-903c-93a31a39d072 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:32.498948 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-26f0dbde-b388-4f2c-903c-93a31a39d072 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:32.639578 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-26f0dbde-b388-4f2c-903c-93a31a39d072 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:32.647844 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-26f0dbde-b388-4f2c-903c-93a31a39d072 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:32.649929 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-26f0dbde-b388-4f2c-903c-93a31a39d072 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:32.651106 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-26f0dbde-b388-4f2c-903c-93a31a39d072 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1725 microversion: 2.20 time: 0.165363 Jul 20 08:36:32.651664 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 558/1132] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:32 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:33.670368 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d7be1e2d-3779-48d7-9be6-c58297ca1194 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:33.671025 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d7be1e2d-3779-48d7-9be6-c58297ca1194 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:33.680145 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d7be1e2d-3779-48d7-9be6-c58297ca1194 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:33.680752 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d7be1e2d-3779-48d7-9be6-c58297ca1194 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:33.681673 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d7be1e2d-3779-48d7-9be6-c58297ca1194 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:33.682273 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d7be1e2d-3779-48d7-9be6-c58297ca1194 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:33.831916 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d7be1e2d-3779-48d7-9be6-c58297ca1194 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:33.841113 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d7be1e2d-3779-48d7-9be6-c58297ca1194 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:33.842607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d7be1e2d-3779-48d7-9be6-c58297ca1194 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:33.843784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d7be1e2d-3779-48d7-9be6-c58297ca1194 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1725 microversion: 2.20 time: 0.177530 Jul 20 08:36:33.844335 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 575/1133] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:33 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:34.862756 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-451c2115-078e-4aa3-a003-44ded57fc6bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:34.863351 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-451c2115-078e-4aa3-a003-44ded57fc6bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:34.870269 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-451c2115-078e-4aa3-a003-44ded57fc6bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:34.870744 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-451c2115-078e-4aa3-a003-44ded57fc6bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:34.871523 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-451c2115-078e-4aa3-a003-44ded57fc6bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:34.871958 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-451c2115-078e-4aa3-a003-44ded57fc6bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:35.013645 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-451c2115-078e-4aa3-a003-44ded57fc6bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:35.024366 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-451c2115-078e-4aa3-a003-44ded57fc6bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:35.025904 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-451c2115-078e-4aa3-a003-44ded57fc6bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:35.027190 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-451c2115-078e-4aa3-a003-44ded57fc6bd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1746 microversion: 2.20 time: 0.168536 Jul 20 08:36:35.027696 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 559/1134] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:34 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:36.045406 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8fdf379c-90ca-4b99-8f64-4f14c1e12a05 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:36.046012 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8fdf379c-90ca-4b99-8f64-4f14c1e12a05 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:36.052834 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8fdf379c-90ca-4b99-8f64-4f14c1e12a05 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:36.053290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8fdf379c-90ca-4b99-8f64-4f14c1e12a05 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:36.054070 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8fdf379c-90ca-4b99-8f64-4f14c1e12a05 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:36.054757 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8fdf379c-90ca-4b99-8f64-4f14c1e12a05 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:36.187249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-8fdf379c-90ca-4b99-8f64-4f14c1e12a05 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:36.196023 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-8fdf379c-90ca-4b99-8f64-4f14c1e12a05 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:36.197517 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-8fdf379c-90ca-4b99-8f64-4f14c1e12a05 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:36.198685 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8fdf379c-90ca-4b99-8f64-4f14c1e12a05 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1746 microversion: 2.20 time: 0.157251 Jul 20 08:36:36.199245 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 576/1135] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:36 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:37.218100 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3c7f11b7-9e04-43e0-8fc0-d880c7233127 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:37.218780 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3c7f11b7-9e04-43e0-8fc0-d880c7233127 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:37.225230 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3c7f11b7-9e04-43e0-8fc0-d880c7233127 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:37.225683 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3c7f11b7-9e04-43e0-8fc0-d880c7233127 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:37.227455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3c7f11b7-9e04-43e0-8fc0-d880c7233127 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:37.227897 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3c7f11b7-9e04-43e0-8fc0-d880c7233127 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:37.364419 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3c7f11b7-9e04-43e0-8fc0-d880c7233127 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:37.373094 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3c7f11b7-9e04-43e0-8fc0-d880c7233127 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:37.374684 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3c7f11b7-9e04-43e0-8fc0-d880c7233127 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:37.375889 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3c7f11b7-9e04-43e0-8fc0-d880c7233127 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1746 microversion: 2.20 time: 0.161852 Jul 20 08:36:37.376447 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 560/1136] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:37 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:37.592663 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9ec948ca-f9a1-49b7-86fc-2649b48b68c1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5aaa03d-8044-4545-9d69-d30c32fe846c"}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:36:37.593858 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9ec948ca-f9a1-49b7-86fc-2649b48b68c1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:37.600399 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9ec948ca-f9a1-49b7-86fc-2649b48b68c1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:37.600854 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9ec948ca-f9a1-49b7-86fc-2649b48b68c1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:37.602136 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9ec948ca-f9a1-49b7-86fc-2649b48b68c1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:37.602571 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9ec948ca-f9a1-49b7-86fc-2649b48b68c1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:37.683806 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-9ec948ca-f9a1-49b7-86fc-2649b48b68c1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] HTTP exception thrown: Invalid volume: volume b5aaa03d-8044-4545-9d69-d30c32fe846c is already attached to instances: b364a329-6312-40e4-b7cf-da7b1dcaca77 Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9ec948ca-f9a1-49b7-86fc-2649b48b68c1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Request method failure captured: Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: POST /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77/os-volume_attachments HTTP/1.1 Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 74 Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wixdWG9rc5IFR0aB2pk_ZbXSzHzAQw9OV7xc6ffVi-gC9dtYrya3ESysbvKCfhbC_hvUIb5xnU9fWVg9utseHpLd4EE5IxzuhHoy9DAbH7v7TBBmqEfRBrYIOvZrsS5CsvlsB_ARu1p91yjGC4MVw6_W2whdtfwL_HLJU3zguHAXQ Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:36:37.685535 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:36:37.686993 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60ee8039b1f4461c996165d5801b91f1", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:36:37.686993 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:36:37.686993 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:36:37.686993 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:36:37.686993 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:36:37.686993 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:36:37.686993 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:36:37.686993 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: e6c2070c6d2a450c887b8ca6b97c4b38 Jul 20 08:36:37.686993 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:36:37.686993 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Jul 20 08:36:37.686993 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {"volumeAttachment": {"volumeId": "b5aaa03d-8044-4545-9d69-d30c32fe846c"}} Jul 20 08:36:37.686993 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:36:37.687754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Invalid volume: volume b5aaa03d-8044-4545-9d69-d30c32fe846c is already attached to instances: b364a329-6312-40e4-b7cf-da7b1dcaca77 Jul 20 08:36:37.687754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'server_id': 'b364a329-6312-40e4-b7cf-da7b1dcaca77', 'body': {'volumeAttachment': {'volumeId': 'b5aaa03d-8044-4545-9d69-d30c32fe846c'}}} Jul 20 08:36:37.687754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:36:37.687754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:36:37.687754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 08:36:37.687754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 08:36:37.687754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 08:36:37.687754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 08:36:37.687754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 08:36:37.687754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 08:36:37.687754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 08:36:37.687754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 08:36:37.687754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 08:36:37.687754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 08:36:37.687754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b5aaa03d-8044-4545-9d69-d30c32fe846c is already attached to instances: b364a329-6312-40e4-b7cf-da7b1dcaca77 Jul 20 08:36:37.687754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:36:37.687754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:36:37.687754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:36:37.687754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:36:37.688941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:36:37.688941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:36:37.688941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:36:37.688941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:36:37.688941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:36:37.688941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:36:37.688941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 08:36:37.688941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 08:36:37.688941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 08:36:37.688941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 08:36:37.688941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 08:36:37.688941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 08:36:37.688941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 08:36:37.688941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 08:36:37.688941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b5aaa03d-8044-4545-9d69-d30c32fe846c is already attached to instances: b364a329-6312-40e4-b7cf-da7b1dcaca77 Jul 20 08:36:37.688941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:36:37.688941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:36:37.688941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:36:37.688941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:36:37.688941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:36:37.690157 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:36:37.690157 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:36:37.690157 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:36:37.690157 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b5aaa03d-8044-4545-9d69-d30c32fe846c is already attached to instances: b364a329-6312-40e4-b7cf-da7b1dcaca77 Jul 20 08:36:37.690157 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:36:37.690157 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9ec948ca-f9a1-49b7-86fc-2649b48b68c1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Returning 400 to user: Invalid volume: volume b5aaa03d-8044-4545-9d69-d30c32fe846c is already attached to instances: b364a329-6312-40e4-b7cf-da7b1dcaca77 {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:36:37.690157 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9ec948ca-f9a1-49b7-86fc-2649b48b68c1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "POST /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098356 Jul 20 08:36:37.690157 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 577/1137] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Jul 20 08:36:37 2022] POST /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 08:36:37.750732 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-862b5d7a-05c2-4a83-a76b-f9a38e245429 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:37.751225 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-862b5d7a-05c2-4a83-a76b-f9a38e245429 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:37.757311 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-862b5d7a-05c2-4a83-a76b-f9a38e245429 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:37.757852 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-862b5d7a-05c2-4a83-a76b-f9a38e245429 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:37.758655 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-862b5d7a-05c2-4a83-a76b-f9a38e245429 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:37.759090 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-862b5d7a-05c2-4a83-a76b-f9a38e245429 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:37.839152 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.objects.instance [None req-862b5d7a-05c2-4a83-a76b-f9a38e245429 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lazy-loading 'services' on Instance uuid b364a329-6312-40e4-b7cf-da7b1dcaca77 {{(pid=117829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:36:37.911548 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-862b5d7a-05c2-4a83-a76b-f9a38e245429 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77/os-volume_attachments/b5aaa03d-8044-4545-9d69-d30c32fe846c" status: 202 len: 0 microversion: 2.1 time: 0.164665 Jul 20 08:36:37.912132 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 561/1138] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Jul 20 08:36:37 2022] DELETE /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77/os-volume_attachments/b5aaa03d-8044-4545-9d69-d30c32fe846c => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:36:37.921227 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8f10e096-0c02-4387-afdd-6561345b3964 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:37.922152 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8f10e096-0c02-4387-afdd-6561345b3964 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:37.928135 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8f10e096-0c02-4387-afdd-6561345b3964 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:37.928706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8f10e096-0c02-4387-afdd-6561345b3964 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:37.929576 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8f10e096-0c02-4387-afdd-6561345b3964 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:37.930089 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8f10e096-0c02-4387-afdd-6561345b3964 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:37.961544 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8f10e096-0c02-4387-afdd-6561345b3964 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044243 Jul 20 08:36:37.962100 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 578/1139] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Jul 20 08:36:37 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:36:38.395984 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-7450911d-a43a-4f3e-b94f-c91ea21dd0a0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:38.396677 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-7450911d-a43a-4f3e-b94f-c91ea21dd0a0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:38.403771 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7450911d-a43a-4f3e-b94f-c91ea21dd0a0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:38.404222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7450911d-a43a-4f3e-b94f-c91ea21dd0a0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:38.405006 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7450911d-a43a-4f3e-b94f-c91ea21dd0a0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:38.405445 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-7450911d-a43a-4f3e-b94f-c91ea21dd0a0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:38.543458 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-7450911d-a43a-4f3e-b94f-c91ea21dd0a0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:38.551549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-7450911d-a43a-4f3e-b94f-c91ea21dd0a0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:38.553078 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-7450911d-a43a-4f3e-b94f-c91ea21dd0a0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:38.554342 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-7450911d-a43a-4f3e-b94f-c91ea21dd0a0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1746 microversion: 2.20 time: 0.163109 Jul 20 08:36:38.554955 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 562/1140] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:38 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1746 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:38.973437 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-60f7d407-bb19-42b8-9457-e431e1e22b00 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:38.974465 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-60f7d407-bb19-42b8-9457-e431e1e22b00 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:38.981686 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-60f7d407-bb19-42b8-9457-e431e1e22b00 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:38.982136 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-60f7d407-bb19-42b8-9457-e431e1e22b00 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:38.982936 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-60f7d407-bb19-42b8-9457-e431e1e22b00 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:38.983372 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-60f7d407-bb19-42b8-9457-e431e1e22b00 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:39.016584 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-60f7d407-bb19-42b8-9457-e431e1e22b00 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047232 Jul 20 08:36:39.017403 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 579/1141] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Jul 20 08:36:38 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 08:36:39.084014 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9d7c6bcd-a9e7-4500-a999-8d7d3c89e0d6 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:39.084525 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9d7c6bcd-a9e7-4500-a999-8d7d3c89e0d6 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:39.090870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9d7c6bcd-a9e7-4500-a999-8d7d3c89e0d6 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:39.091340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9d7c6bcd-a9e7-4500-a999-8d7d3c89e0d6 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:39.092090 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9d7c6bcd-a9e7-4500-a999-8d7d3c89e0d6 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:39.092515 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9d7c6bcd-a9e7-4500-a999-8d7d3c89e0d6 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:39.119162 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9d7c6bcd-a9e7-4500-a999-8d7d3c89e0d6 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Going to try to terminate instance {{(pid=117829) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:36:39.196709 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9d7c6bcd-a9e7-4500-a999-8d7d3c89e0d6 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 204 len: 0 microversion: 2.1 time: 0.116332 Jul 20 08:36:39.200719 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 563/1142] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:36:39 2022] DELETE /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:36:39.206869 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a6b35350-81ac-4f48-a251-b7b2414c13dc tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:39.207558 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a6b35350-81ac-4f48-a251-b7b2414c13dc tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:39.216651 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a6b35350-81ac-4f48-a251-b7b2414c13dc tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:39.217105 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a6b35350-81ac-4f48-a251-b7b2414c13dc tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:39.217885 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a6b35350-81ac-4f48-a251-b7b2414c13dc tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:39.218342 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a6b35350-81ac-4f48-a251-b7b2414c13dc tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:39.366307 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a6b35350-81ac-4f48-a251-b7b2414c13dc tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:39.374956 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a6b35350-81ac-4f48-a251-b7b2414c13dc tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1680 microversion: 2.1 time: 0.171929 Jul 20 08:36:39.375677 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 580/1143] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:36:39 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:36:39.379624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-6348ea90-1f53-40d7-b390-4f4184f5b28e req-cebc4e78-ba48-4679-96e0-cfdf8e42a18b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9589ff-3f5c-4537-9fde-1b5e676b7e09", "name": "network-vif-plugged", "status": "completed", "tag": "08b8e9ae-c7b3-47d7-8038-a5fdfb1440e4"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:36:39.390709 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-6348ea90-1f53-40d7-b390-4f4184f5b28e req-cebc4e78-ba48-4679-96e0-cfdf8e42a18b service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:39.391159 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-6348ea90-1f53-40d7-b390-4f4184f5b28e req-cebc4e78-ba48-4679-96e0-cfdf8e42a18b service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:39.403578 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-6348ea90-1f53-40d7-b390-4f4184f5b28e req-cebc4e78-ba48-4679-96e0-cfdf8e42a18b service nova] Creating event network-vif-plugged:08b8e9ae-c7b3-47d7-8038-a5fdfb1440e4 for instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 on hv-cinder-82308 Jul 20 08:36:39.408366 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-6348ea90-1f53-40d7-b390-4f4184f5b28e req-cebc4e78-ba48-4679-96e0-cfdf8e42a18b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033363 Jul 20 08:36:39.408971 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 564/1144] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:36:39.573112 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a55fa7d1-adff-44c8-8f62-b7f516f34c90 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:39.573761 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a55fa7d1-adff-44c8-8f62-b7f516f34c90 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:39.581095 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a55fa7d1-adff-44c8-8f62-b7f516f34c90 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:39.581542 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a55fa7d1-adff-44c8-8f62-b7f516f34c90 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:39.582462 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a55fa7d1-adff-44c8-8f62-b7f516f34c90 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:39.582922 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a55fa7d1-adff-44c8-8f62-b7f516f34c90 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:39.718386 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a55fa7d1-adff-44c8-8f62-b7f516f34c90 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:39.727483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a55fa7d1-adff-44c8-8f62-b7f516f34c90 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:39.729003 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a55fa7d1-adff-44c8-8f62-b7f516f34c90 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:39.730450 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a55fa7d1-adff-44c8-8f62-b7f516f34c90 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1746 microversion: 2.20 time: 0.161635 Jul 20 08:36:39.731040 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 581/1145] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:39 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:40.393878 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-74ca3d13-2291-4d50-9ef3-693d8391d94d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:40.394567 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-74ca3d13-2291-4d50-9ef3-693d8391d94d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:40.402213 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-74ca3d13-2291-4d50-9ef3-693d8391d94d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:40.402688 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-74ca3d13-2291-4d50-9ef3-693d8391d94d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:40.403474 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-74ca3d13-2291-4d50-9ef3-693d8391d94d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:40.403899 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-74ca3d13-2291-4d50-9ef3-693d8391d94d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:40.547710 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-74ca3d13-2291-4d50-9ef3-693d8391d94d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:40.555990 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-74ca3d13-2291-4d50-9ef3-693d8391d94d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1680 microversion: 2.1 time: 0.166775 Jul 20 08:36:40.556567 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 565/1146] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:36:40 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:36:40.749481 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-2dbe34e5-a4d4-4ef9-b67f-9b02741dd643 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:40.750036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-2dbe34e5-a4d4-4ef9-b67f-9b02741dd643 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:40.756772 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2dbe34e5-a4d4-4ef9-b67f-9b02741dd643 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:40.757312 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2dbe34e5-a4d4-4ef9-b67f-9b02741dd643 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:40.758087 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2dbe34e5-a4d4-4ef9-b67f-9b02741dd643 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:40.758667 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2dbe34e5-a4d4-4ef9-b67f-9b02741dd643 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:40.778293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:36:40.904262 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2dbe34e5-a4d4-4ef9-b67f-9b02741dd643 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:40.913165 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2dbe34e5-a4d4-4ef9-b67f-9b02741dd643 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:40.915470 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2dbe34e5-a4d4-4ef9-b67f-9b02741dd643 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:40.916722 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-2dbe34e5-a4d4-4ef9-b67f-9b02741dd643 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1746 microversion: 2.20 time: 0.171283 Jul 20 08:36:40.917285 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 582/1147] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:40 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:41.574071 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a962108a-73be-4d0a-8d86-d5b155c750ea tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:41.574718 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a962108a-73be-4d0a-8d86-d5b155c750ea tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:41.581263 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a962108a-73be-4d0a-8d86-d5b155c750ea tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:41.581713 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a962108a-73be-4d0a-8d86-d5b155c750ea tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:41.582485 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a962108a-73be-4d0a-8d86-d5b155c750ea tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:41.583027 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a962108a-73be-4d0a-8d86-d5b155c750ea tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:41.834279 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a962108a-73be-4d0a-8d86-d5b155c750ea tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:41.843440 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a962108a-73be-4d0a-8d86-d5b155c750ea tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1680 microversion: 2.1 time: 0.273967 Jul 20 08:36:41.844134 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 566/1148] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:36:41 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1680 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:36:41.935549 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-52e3d46f-98b1-4c11-a22d-ba2a94556285 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:41.936141 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-52e3d46f-98b1-4c11-a22d-ba2a94556285 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:41.942779 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-52e3d46f-98b1-4c11-a22d-ba2a94556285 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:41.943222 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-52e3d46f-98b1-4c11-a22d-ba2a94556285 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:41.943991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-52e3d46f-98b1-4c11-a22d-ba2a94556285 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:41.944417 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-52e3d46f-98b1-4c11-a22d-ba2a94556285 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:42.120702 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-52e3d46f-98b1-4c11-a22d-ba2a94556285 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:42.136296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-52e3d46f-98b1-4c11-a22d-ba2a94556285 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:42.139744 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-52e3d46f-98b1-4c11-a22d-ba2a94556285 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:42.142005 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-52e3d46f-98b1-4c11-a22d-ba2a94556285 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1746 microversion: 2.20 time: 0.210128 Jul 20 08:36:42.143485 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 583/1149] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:41 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1746 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:42.790244 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-b040b44e-1204-45fc-8ee5-2f8d2e34bbc9 req-739a8f21-d289-4a1e-b6b3-99be460f8c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b364a329-6312-40e4-b7cf-da7b1dcaca77", "name": "network-vif-deleted", "tag": "dbd1572d-238c-4ff7-9973-f63b47d0e9aa"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:36:42.804788 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-b040b44e-1204-45fc-8ee5-2f8d2e34bbc9 req-739a8f21-d289-4a1e-b6b3-99be460f8c2c service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:42.807600 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-b040b44e-1204-45fc-8ee5-2f8d2e34bbc9 req-739a8f21-d289-4a1e-b6b3-99be460f8c2c service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:42.815357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:36:42.836097 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-b040b44e-1204-45fc-8ee5-2f8d2e34bbc9 req-739a8f21-d289-4a1e-b6b3-99be460f8c2c service nova] Creating event network-vif-deleted:dbd1572d-238c-4ff7-9973-f63b47d0e9aa for instance b364a329-6312-40e4-b7cf-da7b1dcaca77 on hv-cinder-82308 Jul 20 08:36:42.846292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-b040b44e-1204-45fc-8ee5-2f8d2e34bbc9 req-739a8f21-d289-4a1e-b6b3-99be460f8c2c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151498 Jul 20 08:36:42.848297 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 567/1150] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:36:42.862454 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-640368db-3db0-41ad-b6de-3d7ad9f0386e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:42.863248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-640368db-3db0-41ad-b6de-3d7ad9f0386e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:42.885154 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-640368db-3db0-41ad-b6de-3d7ad9f0386e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:42.885948 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-640368db-3db0-41ad-b6de-3d7ad9f0386e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:42.887077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-640368db-3db0-41ad-b6de-3d7ad9f0386e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:42.887778 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-640368db-3db0-41ad-b6de-3d7ad9f0386e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:42.966118 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-640368db-3db0-41ad-b6de-3d7ad9f0386e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:42.976196 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-640368db-3db0-41ad-b6de-3d7ad9f0386e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 200 len: 1326 microversion: 2.1 time: 0.117382 Jul 20 08:36:42.985312 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 584/1151] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:36:42 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 1326 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:36:43.168564 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c7adcb45-433c-4219-b613-0dae3ef59601 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:43.169186 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c7adcb45-433c-4219-b613-0dae3ef59601 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:43.184333 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c7adcb45-433c-4219-b613-0dae3ef59601 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:43.184780 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c7adcb45-433c-4219-b613-0dae3ef59601 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:43.185575 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c7adcb45-433c-4219-b613-0dae3ef59601 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:43.186006 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c7adcb45-433c-4219-b613-0dae3ef59601 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:43.433157 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c7adcb45-433c-4219-b613-0dae3ef59601 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:43.442361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c7adcb45-433c-4219-b613-0dae3ef59601 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:43.445622 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c7adcb45-433c-4219-b613-0dae3ef59601 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:43.448388 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c7adcb45-433c-4219-b613-0dae3ef59601 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1741 microversion: 2.20 time: 0.286290 Jul 20 08:36:43.449047 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 568/1152] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:43 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1741 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:43.993024 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-82b0cc80-8969-4fa1-97dd-d9dc490aa46e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:43.993670 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-82b0cc80-8969-4fa1-97dd-d9dc490aa46e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:44.023514 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-82b0cc80-8969-4fa1-97dd-d9dc490aa46e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:44.024969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-82b0cc80-8969-4fa1-97dd-d9dc490aa46e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:44.025870 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-82b0cc80-8969-4fa1-97dd-d9dc490aa46e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:44.026329 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-82b0cc80-8969-4fa1-97dd-d9dc490aa46e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:44.052137 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-82b0cc80-8969-4fa1-97dd-d9dc490aa46e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] HTTP exception thrown: Instance b364a329-6312-40e4-b7cf-da7b1dcaca77 could not be found. Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-82b0cc80-8969-4fa1-97dd-d9dc490aa46e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Request method failure captured: Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 HTTP/1.1 Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wixdWG9rc5IFR0aB2pk_ZbXSzHzAQw9OV7xc6ffVi-gC9dtYrya3ESysbvKCfhbC_hvUIb5xnU9fWVg9utseHpLd4EE5IxzuhHoy9DAbH7v7TBBmqEfRBrYIOvZrsS5CsvlsB_ARu1p91yjGC4MVw6_W2whdtfwL_HLJU3zguHAXQ Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:36:44.055198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:36:44.056676 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60ee8039b1f4461c996165d5801b91f1", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:36:44.056676 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:36:44.056676 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:36:44.056676 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:36:44.056676 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:36:44.056676 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:36:44.056676 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:36:44.056676 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: e6c2070c6d2a450c887b8ca6b97c4b38 Jul 20 08:36:44.056676 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:36:44.056676 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:36:44.056676 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance b364a329-6312-40e4-b7cf-da7b1dcaca77 could not be found. Jul 20 08:36:44.056676 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': 'b364a329-6312-40e4-b7cf-da7b1dcaca77'} Jul 20 08:36:44.057469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:36:44.057469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:36:44.057469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:36:44.057469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:36:44.057469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:36:44.057469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:36:44.057469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:36:44.057469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:36:44.057469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:36:44.057469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:36:44.057469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b364a329-6312-40e4-b7cf-da7b1dcaca77 could not be found. Jul 20 08:36:44.057469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:36:44.057469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:36:44.057469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:36:44.057469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:36:44.057469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:36:44.057469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:36:44.057469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:36:44.057469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:36:44.057469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:36:44.058749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:36:44.058749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:36:44.058749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:36:44.058749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:36:44.058749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:36:44.058749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:36:44.058749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:36:44.058749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b364a329-6312-40e4-b7cf-da7b1dcaca77 could not be found. Jul 20 08:36:44.058749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:36:44.058749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:36:44.058749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:36:44.058749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:36:44.058749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:36:44.058749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:36:44.058749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:36:44.058749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:36:44.058749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b364a329-6312-40e4-b7cf-da7b1dcaca77 could not be found. Jul 20 08:36:44.058749 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:36:44.060705 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-82b0cc80-8969-4fa1-97dd-d9dc490aa46e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Returning 404 to user: Instance b364a329-6312-40e4-b7cf-da7b1dcaca77 could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:36:44.066848 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-82b0cc80-8969-4fa1-97dd-d9dc490aa46e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 404 len: 111 microversion: 2.1 time: 0.078339 Jul 20 08:36:44.067811 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 585/1153] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:36:43 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:36:44.077062 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3b6fe684-f0e1-447d-b5e5-5d7317ff8a80 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '.version_select at 0x7fe399e7b9d0>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:44.111170 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3b6fe684-f0e1-447d-b5e5-5d7317ff8a80 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112696103" status: 202 len: 0 microversion: 2.1 time: 0.037801 Jul 20 08:36:44.112176 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 569/1154] 10.222.0.64 () {58 vars in 1220 bytes} [Wed Jul 20 08:36:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112696103 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:36:44.467644 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-27a39f28-e2fb-4500-9b66-ae3677f2587f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:44.468271 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-27a39f28-e2fb-4500-9b66-ae3677f2587f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:44.474692 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-27a39f28-e2fb-4500-9b66-ae3677f2587f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:44.475544 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-27a39f28-e2fb-4500-9b66-ae3677f2587f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:44.477800 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-27a39f28-e2fb-4500-9b66-ae3677f2587f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:44.478497 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-27a39f28-e2fb-4500-9b66-ae3677f2587f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:44.636414 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-27a39f28-e2fb-4500-9b66-ae3677f2587f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:44.648477 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-27a39f28-e2fb-4500-9b66-ae3677f2587f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:44.650652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-27a39f28-e2fb-4500-9b66-ae3677f2587f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:44.651917 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-27a39f28-e2fb-4500-9b66-ae3677f2587f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1741 microversion: 2.20 time: 0.188318 Jul 20 08:36:44.652721 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 586/1155] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:44 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:44.862180 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6c8c37ff-79a4-470b-9967-b72c1fb5463d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Action: 'create', calling method: .version_select at 0x7fe399ec8040>, body: {"keypair": {"name": "tempest-keypair-1861541787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP11UUTlFe/WOxM7zeaZT18Iz/Fw9P1pYEXkuuTg/Nuzluxo7g09VSqhCvXSWDghmSQPq5O3kcnKUA4RtGCqer0P23SD/PRjGDbG4fODU3bdth2hcAwXVlddk0K9a7o00w=="}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:36:44.880290 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-6c8c37ff-79a4-470b-9967-b72c1fb5463d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Getting quotas for project 60ee8039b1f4461c996165d5801b91f1. Resources: {'key_pairs'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:36:44.884803 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-6c8c37ff-79a4-470b-9967-b72c1fb5463d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Getting quotas for user e6c2070c6d2a450c887b8ca6b97c4b38 and project 60ee8039b1f4461c996165d5801b91f1. Resources: {'key_pairs'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:36:44.908968 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6c8c37ff-79a4-470b-9967-b72c1fb5463d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050972 Jul 20 08:36:44.909873 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 570/1156] 10.222.0.64 () {60 vars in 1158 bytes} [Wed Jul 20 08:36:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:36:45.672718 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a0c8eb91-2ff2-413a-af3d-f5cf30a5e518 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:45.673574 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a0c8eb91-2ff2-413a-af3d-f5cf30a5e518 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:45.681875 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a0c8eb91-2ff2-413a-af3d-f5cf30a5e518 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:45.682742 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a0c8eb91-2ff2-413a-af3d-f5cf30a5e518 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:45.684062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a0c8eb91-2ff2-413a-af3d-f5cf30a5e518 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:45.684570 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a0c8eb91-2ff2-413a-af3d-f5cf30a5e518 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:45.946506 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a0c8eb91-2ff2-413a-af3d-f5cf30a5e518 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:45.956735 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a0c8eb91-2ff2-413a-af3d-f5cf30a5e518 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:45.960155 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a0c8eb91-2ff2-413a-af3d-f5cf30a5e518 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:45.962426 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a0c8eb91-2ff2-413a-af3d-f5cf30a5e518 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1741 microversion: 2.20 time: 0.293638 Jul 20 08:36:45.963401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 587/1157] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:45 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1741 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:46.499458 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-68727b7b-3ddf-4d57-8417-990f98671217 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-371857717", "imageRef": "5d6b971e-8afe-4e4a-b054-20cd61970c65", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21da7406-374d-4389-9eee-8af0140c04bf"}], "security_groups": [{"name": "tempest-securitygroup--2079748274"}], "key_name": "tempest-keypair-1861541787", "user_data": "}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:36:46.603958 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.network.neutron [None req-68727b7b-3ddf-4d57-8417-990f98671217 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] validate_networks() for [('21da7406-374d-4389-9eee-8af0140c04bf', None, None, None, None, None)] {{(pid=117829) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:36:46.983214 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-42e73378-357e-427a-aff0-b7f209a56df5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:46.983802 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-42e73378-357e-427a-aff0-b7f209a56df5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:46.990099 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-42e73378-357e-427a-aff0-b7f209a56df5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:46.990543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-42e73378-357e-427a-aff0-b7f209a56df5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:46.991591 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-42e73378-357e-427a-aff0-b7f209a56df5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:46.992026 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-42e73378-357e-427a-aff0-b7f209a56df5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:47.150803 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-42e73378-357e-427a-aff0-b7f209a56df5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:47.159536 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-68727b7b-3ddf-4d57-8417-990f98671217 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Flavor limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:36:47.160293 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-68727b7b-3ddf-4d57-8417-990f98671217 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Image limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:36:47.160865 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-68727b7b-3ddf-4d57-8417-990f98671217 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Flavor pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:36:47.161364 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-68727b7b-3ddf-4d57-8417-990f98671217 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Image pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:36:47.161916 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-42e73378-357e-427a-aff0-b7f209a56df5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:47.164652 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-68727b7b-3ddf-4d57-8417-990f98671217 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:36:47.165566 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-42e73378-357e-427a-aff0-b7f209a56df5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:47.167815 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-42e73378-357e-427a-aff0-b7f209a56df5 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1741 microversion: 2.20 time: 0.189832 Jul 20 08:36:47.168727 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 588/1158] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:46 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:36:47.186998 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-68727b7b-3ddf-4d57-8417-990f98671217 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:47.187455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-68727b7b-3ddf-4d57-8417-990f98671217 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:47.188268 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-68727b7b-3ddf-4d57-8417-990f98671217 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:47.188703 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-68727b7b-3ddf-4d57-8417-990f98671217 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:47.207677 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-68727b7b-3ddf-4d57-8417-990f98671217 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Getting quotas for project 60ee8039b1f4461c996165d5801b91f1. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:36:47.213017 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-68727b7b-3ddf-4d57-8417-990f98671217 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Getting quotas for user e6c2070c6d2a450c887b8ca6b97c4b38 and project 60ee8039b1f4461c996165d5801b91f1. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:36:47.225776 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-68727b7b-3ddf-4d57-8417-990f98671217 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Going to run 1 instances... {{(pid=117829) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:36:47.228147 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-68727b7b-3ddf-4d57-8417-990f98671217 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d6b971e-8afe-4e4a-b054-20cd61970c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117829) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:36:47.278844 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-68727b7b-3ddf-4d57-8417-990f98671217 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.784379 Jul 20 08:36:47.285196 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 571/1159] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Jul 20 08:36:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 08:36:47.291876 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-54fbbe44-c670-4a9d-a8d3-acf8f13538b7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:47.292610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-54fbbe44-c670-4a9d-a8d3-acf8f13538b7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:47.386276 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-54fbbe44-c670-4a9d-a8d3-acf8f13538b7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:47.395431 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-54fbbe44-c670-4a9d-a8d3-acf8f13538b7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1241 microversion: 2.1 time: 0.108570 Jul 20 08:36:47.396290 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 589/1160] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:36:47 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:36:48.187730 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-1451fa9d-7cf1-4b93-9345-29e7f60cf555 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:48.188337 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-1451fa9d-7cf1-4b93-9345-29e7f60cf555 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:48.197244 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1451fa9d-7cf1-4b93-9345-29e7f60cf555 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:48.197811 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1451fa9d-7cf1-4b93-9345-29e7f60cf555 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:48.198653 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1451fa9d-7cf1-4b93-9345-29e7f60cf555 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:48.199090 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1451fa9d-7cf1-4b93-9345-29e7f60cf555 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:48.364073 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1451fa9d-7cf1-4b93-9345-29e7f60cf555 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:48.374635 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1451fa9d-7cf1-4b93-9345-29e7f60cf555 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:48.376677 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1451fa9d-7cf1-4b93-9345-29e7f60cf555 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:48.378424 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-1451fa9d-7cf1-4b93-9345-29e7f60cf555 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1741 microversion: 2.20 time: 0.194982 Jul 20 08:36:48.388025 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 572/1161] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:48 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1741 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:48.413358 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b4efcd60-1824-4cf3-9dc0-ead079b4c8c2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:48.414048 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b4efcd60-1824-4cf3-9dc0-ead079b4c8c2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:48.421604 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b4efcd60-1824-4cf3-9dc0-ead079b4c8c2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:48.423189 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b4efcd60-1824-4cf3-9dc0-ead079b4c8c2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:48.424215 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b4efcd60-1824-4cf3-9dc0-ead079b4c8c2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:48.424989 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b4efcd60-1824-4cf3-9dc0-ead079b4c8c2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:48.495020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b4efcd60-1824-4cf3-9dc0-ead079b4c8c2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:48.504668 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b4efcd60-1824-4cf3-9dc0-ead079b4c8c2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1293 microversion: 2.1 time: 0.095402 Jul 20 08:36:48.510622 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 590/1162] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:36:48 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1293 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:36:49.397851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-0e23d843-8128-4aa4-bc77-58a60850c68d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:49.398899 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-0e23d843-8128-4aa4-bc77-58a60850c68d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:49.408657 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0e23d843-8128-4aa4-bc77-58a60850c68d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:49.409122 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0e23d843-8128-4aa4-bc77-58a60850c68d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:49.409900 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0e23d843-8128-4aa4-bc77-58a60850c68d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:49.410333 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0e23d843-8128-4aa4-bc77-58a60850c68d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:49.523524 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d10f43a2-1d73-493c-a918-2d18bae24fcd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:49.524805 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d10f43a2-1d73-493c-a918-2d18bae24fcd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:49.532317 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d10f43a2-1d73-493c-a918-2d18bae24fcd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:49.532760 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d10f43a2-1d73-493c-a918-2d18bae24fcd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:49.533787 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d10f43a2-1d73-493c-a918-2d18bae24fcd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:49.534229 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d10f43a2-1d73-493c-a918-2d18bae24fcd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:49.749990 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d10f43a2-1d73-493c-a918-2d18bae24fcd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:49.751976 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0e23d843-8128-4aa4-bc77-58a60850c68d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:49.761930 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d10f43a2-1d73-493c-a918-2d18bae24fcd tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1367 microversion: 2.1 time: 0.242410 Jul 20 08:36:49.765823 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0e23d843-8128-4aa4-bc77-58a60850c68d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:49.773771 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0e23d843-8128-4aa4-bc77-58a60850c68d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:49.774200 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 591/1163] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:36:49 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:36:49.776651 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-0e23d843-8128-4aa4-bc77-58a60850c68d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1741 microversion: 2.20 time: 0.382946 Jul 20 08:36:49.779907 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 573/1164] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:49 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1741 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:50.563610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-e007444c-e064-470b-81b7-d4a7fcc20c4f req-14f08903-ae3d-4441-95fb-c7832f87517f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c207a53a-b0d9-4d09-8ce1-beecdf160eef", "tag": "f0b4011c-e1be-4ef1-914b-9e51374f2b5f"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:36:50.588517 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-e007444c-e064-470b-81b7-d4a7fcc20c4f req-14f08903-ae3d-4441-95fb-c7832f87517f service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:50.589464 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-e007444c-e064-470b-81b7-d4a7fcc20c4f req-14f08903-ae3d-4441-95fb-c7832f87517f service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:50.601272 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-e007444c-e064-470b-81b7-d4a7fcc20c4f req-14f08903-ae3d-4441-95fb-c7832f87517f service nova] Creating event network-changed:f0b4011c-e1be-4ef1-914b-9e51374f2b5f for instance c207a53a-b0d9-4d09-8ce1-beecdf160eef on hv-cinder-82308 Jul 20 08:36:50.606764 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-e007444c-e064-470b-81b7-d4a7fcc20c4f req-14f08903-ae3d-4441-95fb-c7832f87517f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054214 Jul 20 08:36:50.607441 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 592/1165] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:36:50.780652 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-792b11f6-d403-4cf0-bb9a-9dee7d92d447 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:50.781622 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-792b11f6-d403-4cf0-bb9a-9dee7d92d447 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:50.792579 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:36:50.810809 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a40ac187-948a-425b-91d4-76e5ab408cb3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:50.812886 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a40ac187-948a-425b-91d4-76e5ab408cb3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:50.819622 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-792b11f6-d403-4cf0-bb9a-9dee7d92d447 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:50.820621 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-792b11f6-d403-4cf0-bb9a-9dee7d92d447 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:50.823048 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-792b11f6-d403-4cf0-bb9a-9dee7d92d447 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:50.825401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a40ac187-948a-425b-91d4-76e5ab408cb3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:50.826193 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-792b11f6-d403-4cf0-bb9a-9dee7d92d447 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:50.827585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a40ac187-948a-425b-91d4-76e5ab408cb3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:50.828708 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a40ac187-948a-425b-91d4-76e5ab408cb3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:50.829160 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a40ac187-948a-425b-91d4-76e5ab408cb3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:51.055853 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a40ac187-948a-425b-91d4-76e5ab408cb3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:51.066644 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a40ac187-948a-425b-91d4-76e5ab408cb3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:51.069036 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a40ac187-948a-425b-91d4-76e5ab408cb3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:51.071607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a40ac187-948a-425b-91d4-76e5ab408cb3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1741 microversion: 2.20 time: 0.265435 Jul 20 08:36:51.073121 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 593/1166] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:50 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1741 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:51.116861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-792b11f6-d403-4cf0-bb9a-9dee7d92d447 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:51.125720 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-792b11f6-d403-4cf0-bb9a-9dee7d92d447 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1367 microversion: 2.1 time: 0.349664 Jul 20 08:36:51.135257 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 574/1167] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:36:50 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:36:52.093002 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f6d71f68-41bb-4832-a0a2-35efb2a5a69a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:52.093632 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f6d71f68-41bb-4832-a0a2-35efb2a5a69a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:52.100244 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f6d71f68-41bb-4832-a0a2-35efb2a5a69a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:52.101340 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f6d71f68-41bb-4832-a0a2-35efb2a5a69a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:52.102122 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f6d71f68-41bb-4832-a0a2-35efb2a5a69a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:52.102559 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f6d71f68-41bb-4832-a0a2-35efb2a5a69a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:52.142926 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c1018c0e-b596-47c9-b477-87d2b321360a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:52.143526 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c1018c0e-b596-47c9-b477-87d2b321360a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:52.151391 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c1018c0e-b596-47c9-b477-87d2b321360a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:52.152117 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c1018c0e-b596-47c9-b477-87d2b321360a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:52.153069 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c1018c0e-b596-47c9-b477-87d2b321360a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:52.153677 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c1018c0e-b596-47c9-b477-87d2b321360a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:52.266375 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f6d71f68-41bb-4832-a0a2-35efb2a5a69a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:52.284356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f6d71f68-41bb-4832-a0a2-35efb2a5a69a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:52.286253 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f6d71f68-41bb-4832-a0a2-35efb2a5a69a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:52.291091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f6d71f68-41bb-4832-a0a2-35efb2a5a69a tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1741 microversion: 2.20 time: 0.201901 Jul 20 08:36:52.302289 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 594/1168] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:52 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1741 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:52.332445 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c1018c0e-b596-47c9-b477-87d2b321360a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:52.342183 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c1018c0e-b596-47c9-b477-87d2b321360a tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1367 microversion: 2.1 time: 0.203326 Jul 20 08:36:52.343138 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 575/1169] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:36:52 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:36:53.317028 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-6447f880-fe6c-4e11-b047-9d3731cb657c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:53.318140 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-6447f880-fe6c-4e11-b047-9d3731cb657c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:53.325426 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=55 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:36:53.332320 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6447f880-fe6c-4e11-b047-9d3731cb657c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:53.333095 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6447f880-fe6c-4e11-b047-9d3731cb657c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:53.334452 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6447f880-fe6c-4e11-b047-9d3731cb657c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:53.336095 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6447f880-fe6c-4e11-b047-9d3731cb657c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:53.360033 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6d4f5205-507e-47de-ab8a-4650ad7f5b23 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:53.360664 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6d4f5205-507e-47de-ab8a-4650ad7f5b23 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:53.368020 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6d4f5205-507e-47de-ab8a-4650ad7f5b23 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:53.368464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6d4f5205-507e-47de-ab8a-4650ad7f5b23 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:53.369272 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6d4f5205-507e-47de-ab8a-4650ad7f5b23 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:53.369874 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6d4f5205-507e-47de-ab8a-4650ad7f5b23 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:53.492752 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-6447f880-fe6c-4e11-b047-9d3731cb657c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:53.501520 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-6447f880-fe6c-4e11-b047-9d3731cb657c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:53.503073 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-6447f880-fe6c-4e11-b047-9d3731cb657c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:53.504303 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-6447f880-fe6c-4e11-b047-9d3731cb657c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1741 microversion: 2.20 time: 0.196317 Jul 20 08:36:53.506685 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 595/1170] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:53 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1741 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:36:53.519778 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6d4f5205-507e-47de-ab8a-4650ad7f5b23 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:53.530223 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6d4f5205-507e-47de-ab8a-4650ad7f5b23 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1367 microversion: 2.1 time: 0.173976 Jul 20 08:36:53.530868 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 576/1171] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:36:53 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:36:54.533593 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-18f5cde6-96e0-4bc7-80b2-eb2a12a67cfa tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:54.534979 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-18f5cde6-96e0-4bc7-80b2-eb2a12a67cfa tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:54.550555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f001598c-dac1-47c2-b093-62043b7f4fb0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:54.551934 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f001598c-dac1-47c2-b093-62043b7f4fb0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:54.560686 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-18f5cde6-96e0-4bc7-80b2-eb2a12a67cfa tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:54.563151 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f001598c-dac1-47c2-b093-62043b7f4fb0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:54.564507 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-18f5cde6-96e0-4bc7-80b2-eb2a12a67cfa tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:54.565605 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-18f5cde6-96e0-4bc7-80b2-eb2a12a67cfa tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:54.566370 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f001598c-dac1-47c2-b093-62043b7f4fb0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:54.567182 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-18f5cde6-96e0-4bc7-80b2-eb2a12a67cfa tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:54.568234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f001598c-dac1-47c2-b093-62043b7f4fb0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:54.573123 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f001598c-dac1-47c2-b093-62043b7f4fb0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:54.763514 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-18f5cde6-96e0-4bc7-80b2-eb2a12a67cfa tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:54.773904 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-18f5cde6-96e0-4bc7-80b2-eb2a12a67cfa tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:54.776272 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-18f5cde6-96e0-4bc7-80b2-eb2a12a67cfa tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:54.777920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-18f5cde6-96e0-4bc7-80b2-eb2a12a67cfa tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1741 microversion: 2.20 time: 0.256268 Jul 20 08:36:54.779113 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 596/1172] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:54 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1741 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:54.904096 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f001598c-dac1-47c2-b093-62043b7f4fb0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:54.920622 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f001598c-dac1-47c2-b093-62043b7f4fb0 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1367 microversion: 2.1 time: 0.374854 Jul 20 08:36:54.921988 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 577/1173] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:36:54 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1367 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:36:55.804760 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b3eb98a1-2f7a-4d54-935a-198d2ee5aa3e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:55.805362 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b3eb98a1-2f7a-4d54-935a-198d2ee5aa3e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:55.811940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b3eb98a1-2f7a-4d54-935a-198d2ee5aa3e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:55.812390 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b3eb98a1-2f7a-4d54-935a-198d2ee5aa3e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:55.813155 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b3eb98a1-2f7a-4d54-935a-198d2ee5aa3e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:55.813597 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b3eb98a1-2f7a-4d54-935a-198d2ee5aa3e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:55.940762 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-677e02a1-0848-4615-8d44-4ca2e34d5138 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:55.941390 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-677e02a1-0848-4615-8d44-4ca2e34d5138 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:55.948800 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-677e02a1-0848-4615-8d44-4ca2e34d5138 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:55.949464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-677e02a1-0848-4615-8d44-4ca2e34d5138 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:55.950345 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-677e02a1-0848-4615-8d44-4ca2e34d5138 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:55.950877 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-677e02a1-0848-4615-8d44-4ca2e34d5138 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:55.951442 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b3eb98a1-2f7a-4d54-935a-198d2ee5aa3e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:55.960124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b3eb98a1-2f7a-4d54-935a-198d2ee5aa3e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:55.961627 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b3eb98a1-2f7a-4d54-935a-198d2ee5aa3e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:55.962831 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b3eb98a1-2f7a-4d54-935a-198d2ee5aa3e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1741 microversion: 2.20 time: 0.162234 Jul 20 08:36:55.963405 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 597/1174] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:55 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:56.085954 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-677e02a1-0848-4615-8d44-4ca2e34d5138 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:56.093482 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-677e02a1-0848-4615-8d44-4ca2e34d5138 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1367 microversion: 2.1 time: 0.156680 Jul 20 08:36:56.094054 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 578/1175] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:36:55 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:36:56.982686 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3ed6d8d3-a78a-4845-9883-16df515738bb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:56.983684 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-3ed6d8d3-a78a-4845-9883-16df515738bb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:56.990397 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ed6d8d3-a78a-4845-9883-16df515738bb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:56.990999 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ed6d8d3-a78a-4845-9883-16df515738bb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:56.992314 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ed6d8d3-a78a-4845-9883-16df515738bb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:56.992752 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ed6d8d3-a78a-4845-9883-16df515738bb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:57.111066 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-bcdb3fb1-fa9f-4b3d-a8be-badc27355649 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:57.112784 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-bcdb3fb1-fa9f-4b3d-a8be-badc27355649 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:57.120803 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bcdb3fb1-fa9f-4b3d-a8be-badc27355649 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:57.121249 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bcdb3fb1-fa9f-4b3d-a8be-badc27355649 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:57.122295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bcdb3fb1-fa9f-4b3d-a8be-badc27355649 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:57.122795 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-bcdb3fb1-fa9f-4b3d-a8be-badc27355649 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:57.139069 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3ed6d8d3-a78a-4845-9883-16df515738bb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:57.147024 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3ed6d8d3-a78a-4845-9883-16df515738bb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:57.148875 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3ed6d8d3-a78a-4845-9883-16df515738bb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:57.150038 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-3ed6d8d3-a78a-4845-9883-16df515738bb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1723 microversion: 2.20 time: 0.172082 Jul 20 08:36:57.150799 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 598/1176] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:56 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:57.197423 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=2 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:36:57.220547 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=10 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:36:57.338668 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-bcdb3fb1-fa9f-4b3d-a8be-badc27355649 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:57.346311 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-bcdb3fb1-fa9f-4b3d-a8be-badc27355649 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1367 microversion: 2.1 time: 0.240713 Jul 20 08:36:57.347136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 579/1177] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:36:57 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:36:57.660501 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=2 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:36:57.721380 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-1f5b1135-6f9c-4cc2-a060-7a24fb54bbfa req-684ac91c-90d0-4d23-812d-11d796884b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c207a53a-b0d9-4d09-8ce1-beecdf160eef", "name": "network-vif-plugged", "status": "completed", "tag": "f0b4011c-e1be-4ef1-914b-9e51374f2b5f"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:36:57.729964 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-1f5b1135-6f9c-4cc2-a060-7a24fb54bbfa req-684ac91c-90d0-4d23-812d-11d796884b2e service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:57.730408 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-1f5b1135-6f9c-4cc2-a060-7a24fb54bbfa req-684ac91c-90d0-4d23-812d-11d796884b2e service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:57.748136 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-1f5b1135-6f9c-4cc2-a060-7a24fb54bbfa req-684ac91c-90d0-4d23-812d-11d796884b2e service nova] Creating event network-vif-plugged:f0b4011c-e1be-4ef1-914b-9e51374f2b5f for instance c207a53a-b0d9-4d09-8ce1-beecdf160eef on hv-cinder-82308 Jul 20 08:36:57.753124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-1f5b1135-6f9c-4cc2-a060-7a24fb54bbfa req-684ac91c-90d0-4d23-812d-11d796884b2e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096881 Jul 20 08:36:57.753655 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 599/1178] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:36:58.169784 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-0159380f-efcd-48db-bab2-fb5e0b293a38 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:58.170396 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-0159380f-efcd-48db-bab2-fb5e0b293a38 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:58.176894 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0159380f-efcd-48db-bab2-fb5e0b293a38 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:58.177372 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0159380f-efcd-48db-bab2-fb5e0b293a38 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:58.178141 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0159380f-efcd-48db-bab2-fb5e0b293a38 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:58.179130 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0159380f-efcd-48db-bab2-fb5e0b293a38 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:58.320628 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0159380f-efcd-48db-bab2-fb5e0b293a38 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:58.329391 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0159380f-efcd-48db-bab2-fb5e0b293a38 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:58.330910 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0159380f-efcd-48db-bab2-fb5e0b293a38 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:58.332069 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-0159380f-efcd-48db-bab2-fb5e0b293a38 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1723 microversion: 2.20 time: 0.166363 Jul 20 08:36:58.332631 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 580/1179] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:58 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:58.364786 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b440e366-2349-4566-8350-a8cc27be57c7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:58.365511 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b440e366-2349-4566-8350-a8cc27be57c7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:58.372391 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b440e366-2349-4566-8350-a8cc27be57c7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:58.372841 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b440e366-2349-4566-8350-a8cc27be57c7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:58.373610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b440e366-2349-4566-8350-a8cc27be57c7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:58.374046 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b440e366-2349-4566-8350-a8cc27be57c7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:58.503798 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b440e366-2349-4566-8350-a8cc27be57c7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:58.511426 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b440e366-2349-4566-8350-a8cc27be57c7 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1367 microversion: 2.1 time: 0.151775 Jul 20 08:36:58.512066 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 600/1180] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:36:58 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:36:59.351876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4a000fad-f39e-4797-b2b3-4fb6bdddd7e4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:59.352668 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4a000fad-f39e-4797-b2b3-4fb6bdddd7e4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:59.359425 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4a000fad-f39e-4797-b2b3-4fb6bdddd7e4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:59.359869 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4a000fad-f39e-4797-b2b3-4fb6bdddd7e4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:59.360647 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4a000fad-f39e-4797-b2b3-4fb6bdddd7e4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:59.361182 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4a000fad-f39e-4797-b2b3-4fb6bdddd7e4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:59.496062 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4a000fad-f39e-4797-b2b3-4fb6bdddd7e4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:59.503999 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4a000fad-f39e-4797-b2b3-4fb6bdddd7e4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:59.505493 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-4a000fad-f39e-4797-b2b3-4fb6bdddd7e4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:59.506936 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4a000fad-f39e-4797-b2b3-4fb6bdddd7e4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1723 microversion: 2.20 time: 0.159530 Jul 20 08:36:59.507574 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 581/1181] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:36:59 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:36:59.529369 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0c1dc8b8-d66a-454c-8aea-0bf9ee4dc636 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:36:59.529990 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0c1dc8b8-d66a-454c-8aea-0bf9ee4dc636 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:36:59.536590 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0c1dc8b8-d66a-454c-8aea-0bf9ee4dc636 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:59.537030 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0c1dc8b8-d66a-454c-8aea-0bf9ee4dc636 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:59.538280 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0c1dc8b8-d66a-454c-8aea-0bf9ee4dc636 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:36:59.538742 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0c1dc8b8-d66a-454c-8aea-0bf9ee4dc636 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:36:59.676092 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-0c1dc8b8-d66a-454c-8aea-0bf9ee4dc636 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:36:59.683677 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0c1dc8b8-d66a-454c-8aea-0bf9ee4dc636 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1367 microversion: 2.1 time: 0.158525 Jul 20 08:36:59.684257 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 601/1182] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:36:59 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:00.525846 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ef75e8c4-2e91-4509-a1bb-04f17cca5072 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:00.526527 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ef75e8c4-2e91-4509-a1bb-04f17cca5072 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:00.533209 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ef75e8c4-2e91-4509-a1bb-04f17cca5072 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:00.533639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ef75e8c4-2e91-4509-a1bb-04f17cca5072 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:00.534404 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ef75e8c4-2e91-4509-a1bb-04f17cca5072 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:00.534863 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ef75e8c4-2e91-4509-a1bb-04f17cca5072 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:00.671285 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ef75e8c4-2e91-4509-a1bb-04f17cca5072 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:00.680506 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ef75e8c4-2e91-4509-a1bb-04f17cca5072 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:00.682018 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ef75e8c4-2e91-4509-a1bb-04f17cca5072 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:00.683234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ef75e8c4-2e91-4509-a1bb-04f17cca5072 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1723 microversion: 2.20 time: 0.161568 Jul 20 08:37:00.683807 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 582/1183] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:00 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:37:00.702098 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f8f9a5c0-2cfa-4b6f-971b-4563fac81e9d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:00.702750 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f8f9a5c0-2cfa-4b6f-971b-4563fac81e9d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:00.709312 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f8f9a5c0-2cfa-4b6f-971b-4563fac81e9d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:00.709974 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f8f9a5c0-2cfa-4b6f-971b-4563fac81e9d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:00.710864 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f8f9a5c0-2cfa-4b6f-971b-4563fac81e9d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:00.711298 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f8f9a5c0-2cfa-4b6f-971b-4563fac81e9d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:00.715578 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=100 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:37:00.848357 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f8f9a5c0-2cfa-4b6f-971b-4563fac81e9d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:00.856636 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f8f9a5c0-2cfa-4b6f-971b-4563fac81e9d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1367 microversion: 2.1 time: 0.159061 Jul 20 08:37:00.857224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 602/1184] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:00 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:01.702871 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-40072ea6-cf9b-456c-8946-8c28dd92fca0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:01.703735 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-40072ea6-cf9b-456c-8946-8c28dd92fca0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:01.716523 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-40072ea6-cf9b-456c-8946-8c28dd92fca0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:01.717320 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-40072ea6-cf9b-456c-8946-8c28dd92fca0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:01.718745 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-40072ea6-cf9b-456c-8946-8c28dd92fca0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:01.719534 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-40072ea6-cf9b-456c-8946-8c28dd92fca0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:01.868547 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-40072ea6-cf9b-456c-8946-8c28dd92fca0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:01.873936 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1e8e3132-46fe-4000-b273-4db28c21cd38 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:01.874518 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1e8e3132-46fe-4000-b273-4db28c21cd38 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:01.878014 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-40072ea6-cf9b-456c-8946-8c28dd92fca0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:01.879564 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-40072ea6-cf9b-456c-8946-8c28dd92fca0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:01.880741 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-40072ea6-cf9b-456c-8946-8c28dd92fca0 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1723 microversion: 2.20 time: 0.182075 Jul 20 08:37:01.881153 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1e8e3132-46fe-4000-b273-4db28c21cd38 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:01.881716 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 583/1185] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:01 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:37:01.881836 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1e8e3132-46fe-4000-b273-4db28c21cd38 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:01.882849 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1e8e3132-46fe-4000-b273-4db28c21cd38 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:01.883284 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1e8e3132-46fe-4000-b273-4db28c21cd38 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:02.122450 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1e8e3132-46fe-4000-b273-4db28c21cd38 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:02.130901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1e8e3132-46fe-4000-b273-4db28c21cd38 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1367 microversion: 2.1 time: 0.260745 Jul 20 08:37:02.143714 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 603/1186] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:01 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:02.800797 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-271ca660-1c17-4add-a35f-51949506b9f8 req-2c58638e-5fe6-49ed-8a27-a29e8429287b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9589ff-3f5c-4537-9fde-1b5e676b7e09", "name": "network-vif-unplugged", "status": "completed", "tag": "08b8e9ae-c7b3-47d7-8038-a5fdfb1440e4"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:37:02.813545 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-271ca660-1c17-4add-a35f-51949506b9f8 req-2c58638e-5fe6-49ed-8a27-a29e8429287b service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:02.814671 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-271ca660-1c17-4add-a35f-51949506b9f8 req-2c58638e-5fe6-49ed-8a27-a29e8429287b service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:02.828963 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-271ca660-1c17-4add-a35f-51949506b9f8 req-2c58638e-5fe6-49ed-8a27-a29e8429287b service nova] Creating event network-vif-unplugged:08b8e9ae-c7b3-47d7-8038-a5fdfb1440e4 for instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 on hv-cinder-82308 Jul 20 08:37:02.834813 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-271ca660-1c17-4add-a35f-51949506b9f8 req-2c58638e-5fe6-49ed-8a27-a29e8429287b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043736 Jul 20 08:37:02.836199 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 584/1187] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:37:02.860387 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-aea906a0-be54-4fac-ae07-8de4a6035973 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:02.861926 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-aea906a0-be54-4fac-ae07-8de4a6035973 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:02.870116 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aea906a0-be54-4fac-ae07-8de4a6035973 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:02.870784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aea906a0-be54-4fac-ae07-8de4a6035973 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:02.872358 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aea906a0-be54-4fac-ae07-8de4a6035973 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:02.873386 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aea906a0-be54-4fac-ae07-8de4a6035973 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:02.904130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-aea906a0-be54-4fac-ae07-8de4a6035973 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Going to try to terminate instance {{(pid=117828) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:37:02.954103 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-bdb28267-db61-4a55-851d-efe79875353c req-dd080e53-c99c-41a7-aaba-d982aab0f913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e518b913-0606-4cd9-96f7-dfcf59ff8758", "tag": "74d72a98-84ae-4d18-bd71-3bf590c0a455"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:37:02.973177 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-bdb28267-db61-4a55-851d-efe79875353c req-dd080e53-c99c-41a7-aaba-d982aab0f913 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:02.974065 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-bdb28267-db61-4a55-851d-efe79875353c req-dd080e53-c99c-41a7-aaba-d982aab0f913 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:02.996000 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-aea906a0-be54-4fac-ae07-8de4a6035973 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 204 len: 0 microversion: 2.1 time: 0.140403 Jul 20 08:37:02.996988 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 604/1188] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:37:02 2022] DELETE /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:37:02.997575 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-bdb28267-db61-4a55-851d-efe79875353c req-dd080e53-c99c-41a7-aaba-d982aab0f913 service nova] Creating event network-changed:74d72a98-84ae-4d18-bd71-3bf590c0a455 for instance e518b913-0606-4cd9-96f7-dfcf59ff8758 on hv-cinder-82308 Jul 20 08:37:03.005256 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-bdb28267-db61-4a55-851d-efe79875353c req-dd080e53-c99c-41a7-aaba-d982aab0f913 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146543 Jul 20 08:37:03.006244 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 585/1189] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:37:03.011934 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-be88ec47-0fe3-48ae-aaba-97c96293313d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:03.012356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-be88ec47-0fe3-48ae-aaba-97c96293313d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:03.016778 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9e0175d5-39c4-4eda-99f6-be054be4978c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:03.018327 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9e0175d5-39c4-4eda-99f6-be054be4978c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:03.020201 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-be88ec47-0fe3-48ae-aaba-97c96293313d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:03.020643 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-be88ec47-0fe3-48ae-aaba-97c96293313d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:03.021632 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-be88ec47-0fe3-48ae-aaba-97c96293313d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:03.023003 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-be88ec47-0fe3-48ae-aaba-97c96293313d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:03.026831 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9e0175d5-39c4-4eda-99f6-be054be4978c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:03.027287 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9e0175d5-39c4-4eda-99f6-be054be4978c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:03.028070 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9e0175d5-39c4-4eda-99f6-be054be4978c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:03.028506 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9e0175d5-39c4-4eda-99f6-be054be4978c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:03.231305 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-be88ec47-0fe3-48ae-aaba-97c96293313d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:03.241859 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-be88ec47-0fe3-48ae-aaba-97c96293313d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:03.244090 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-be88ec47-0fe3-48ae-aaba-97c96293313d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:03.246102 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-be88ec47-0fe3-48ae-aaba-97c96293313d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1723 microversion: 2.20 time: 0.247637 Jul 20 08:37:03.260119 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 605/1190] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:02 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:37:03.269728 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7a307f8b-5125-457d-bf85-5d184905abd8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:03.271006 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-7a307f8b-5125-457d-bf85-5d184905abd8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:03.278804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7a307f8b-5125-457d-bf85-5d184905abd8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:03.279352 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7a307f8b-5125-457d-bf85-5d184905abd8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:03.280382 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7a307f8b-5125-457d-bf85-5d184905abd8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:03.280975 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7a307f8b-5125-457d-bf85-5d184905abd8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:03.328930 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9e0175d5-39c4-4eda-99f6-be054be4978c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:03.341545 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9e0175d5-39c4-4eda-99f6-be054be4978c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1567 microversion: 2.1 time: 0.333198 Jul 20 08:37:03.342346 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 586/1191] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:03 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1567 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:03.445485 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-7a307f8b-5125-457d-bf85-5d184905abd8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:03.453484 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-7a307f8b-5125-457d-bf85-5d184905abd8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1367 microversion: 2.1 time: 0.191890 Jul 20 08:37:03.454134 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 606/1192] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:03 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:04.267396 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-85342f90-cbc7-4ae0-af75-877d1835dcf4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:04.267924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-85342f90-cbc7-4ae0-af75-877d1835dcf4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:04.274798 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-85342f90-cbc7-4ae0-af75-877d1835dcf4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:04.275244 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-85342f90-cbc7-4ae0-af75-877d1835dcf4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:04.276027 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-85342f90-cbc7-4ae0-af75-877d1835dcf4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:04.276456 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-85342f90-cbc7-4ae0-af75-877d1835dcf4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:04.360614 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-bfb3b95e-d4e4-482c-86eb-2057fa4eb971 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:04.361615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-bfb3b95e-d4e4-482c-86eb-2057fa4eb971 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:04.368633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bfb3b95e-d4e4-482c-86eb-2057fa4eb971 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:04.369082 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bfb3b95e-d4e4-482c-86eb-2057fa4eb971 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:04.369864 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bfb3b95e-d4e4-482c-86eb-2057fa4eb971 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:04.370323 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bfb3b95e-d4e4-482c-86eb-2057fa4eb971 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:04.419654 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-85342f90-cbc7-4ae0-af75-877d1835dcf4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:04.428004 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-85342f90-cbc7-4ae0-af75-877d1835dcf4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:04.430362 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-85342f90-cbc7-4ae0-af75-877d1835dcf4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:04.431564 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-85342f90-cbc7-4ae0-af75-877d1835dcf4 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1723 microversion: 2.20 time: 0.168444 Jul 20 08:37:04.432126 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 587/1193] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:04 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:37:04.471287 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-61bc18be-837d-4427-84f4-c41cadd8b983 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:04.472045 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-61bc18be-837d-4427-84f4-c41cadd8b983 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:04.479043 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-61bc18be-837d-4427-84f4-c41cadd8b983 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:04.479991 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-61bc18be-837d-4427-84f4-c41cadd8b983 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:04.480519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-61bc18be-837d-4427-84f4-c41cadd8b983 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:04.480987 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-61bc18be-837d-4427-84f4-c41cadd8b983 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:04.506117 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=100 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:37:04.517335 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-bfb3b95e-d4e4-482c-86eb-2057fa4eb971 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:04.526068 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-bfb3b95e-d4e4-482c-86eb-2057fa4eb971 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1567 microversion: 2.1 time: 0.169214 Jul 20 08:37:04.526721 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 607/1194] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:04 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:37:04.633044 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-61bc18be-837d-4427-84f4-c41cadd8b983 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:04.641594 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-61bc18be-837d-4427-84f4-c41cadd8b983 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1367 microversion: 2.1 time: 0.174089 Jul 20 08:37:04.642511 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 588/1195] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:04 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:37:05.450812 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-82f0b271-4a4a-4d9d-a012-cc05d1d3199e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:05.451445 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-82f0b271-4a4a-4d9d-a012-cc05d1d3199e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:05.458524 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-82f0b271-4a4a-4d9d-a012-cc05d1d3199e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:05.458996 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-82f0b271-4a4a-4d9d-a012-cc05d1d3199e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:05.460514 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-82f0b271-4a4a-4d9d-a012-cc05d1d3199e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:05.460989 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-82f0b271-4a4a-4d9d-a012-cc05d1d3199e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:05.543798 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-fa78ef24-fd5d-4686-934f-e43270f984ac tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:05.544536 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-fa78ef24-fd5d-4686-934f-e43270f984ac tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:05.551056 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa78ef24-fd5d-4686-934f-e43270f984ac tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:05.551626 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa78ef24-fd5d-4686-934f-e43270f984ac tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:05.552414 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa78ef24-fd5d-4686-934f-e43270f984ac tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:05.552880 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa78ef24-fd5d-4686-934f-e43270f984ac tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:05.613438 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-82f0b271-4a4a-4d9d-a012-cc05d1d3199e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:05.623407 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-82f0b271-4a4a-4d9d-a012-cc05d1d3199e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:05.624903 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-82f0b271-4a4a-4d9d-a012-cc05d1d3199e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:05.626064 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-82f0b271-4a4a-4d9d-a012-cc05d1d3199e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1726 microversion: 2.20 time: 0.179284 Jul 20 08:37:05.626839 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 608/1196] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:05 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:37:05.645188 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-33964ef2-accc-4e63-a9ee-4e2f4e0ec8e2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "275a4ba4-e1ed-4050-a3b1-95f1abebdcd7"}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:37:05.646322 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-33964ef2-accc-4e63-a9ee-4e2f4e0ec8e2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:05.655288 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-33964ef2-accc-4e63-a9ee-4e2f4e0ec8e2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:05.655737 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-33964ef2-accc-4e63-a9ee-4e2f4e0ec8e2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:05.656508 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-33964ef2-accc-4e63-a9ee-4e2f4e0ec8e2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:05.656938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-33964ef2-accc-4e63-a9ee-4e2f4e0ec8e2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:05.717069 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fa78ef24-fd5d-4686-934f-e43270f984ac tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:05.733309 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-fa78ef24-fd5d-4686-934f-e43270f984ac tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1567 microversion: 2.1 time: 0.192909 Jul 20 08:37:05.734778 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 589/1197] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:05 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:37:05.740220 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9767863a-dff5-4758-9807-a66c083ff6e8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:05.741718 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9767863a-dff5-4758-9807-a66c083ff6e8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:05.749188 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9767863a-dff5-4758-9807-a66c083ff6e8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:05.749635 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9767863a-dff5-4758-9807-a66c083ff6e8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:05.750801 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9767863a-dff5-4758-9807-a66c083ff6e8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:05.750969 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9767863a-dff5-4758-9807-a66c083ff6e8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:05.907631 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9767863a-dff5-4758-9807-a66c083ff6e8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:05.917002 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9767863a-dff5-4758-9807-a66c083ff6e8 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1367 microversion: 2.1 time: 0.181082 Jul 20 08:37:05.917708 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 590/1198] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:05 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:05.962650 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-33964ef2-accc-4e63-a9ee-4e2f4e0ec8e2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "POST /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.321172 Jul 20 08:37:05.963684 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 609/1199] 10.222.0.64 () {62 vars in 1363 bytes} [Wed Jul 20 08:37:05 2022] POST /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09/os-volume_attachments => generated 188 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 08:37:06.103998 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-415214cb-5a15-4670-9d98-aba6390cff11 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:06.104488 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-415214cb-5a15-4670-9d98-aba6390cff11 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:06.110870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-415214cb-5a15-4670-9d98-aba6390cff11 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:06.111307 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-415214cb-5a15-4670-9d98-aba6390cff11 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:06.112067 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-415214cb-5a15-4670-9d98-aba6390cff11 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:06.112492 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-415214cb-5a15-4670-9d98-aba6390cff11 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:06.377098 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-415214cb-5a15-4670-9d98-aba6390cff11 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09/os-volume_attachments/275a4ba4-e1ed-4050-a3b1-95f1abebdcd7" status: 202 len: 0 microversion: 2.20 time: 0.277148 Jul 20 08:37:06.379113 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 591/1200] 10.222.0.64 () {60 vars in 1456 bytes} [Wed Jul 20 08:37:06 2022] DELETE /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09/os-volume_attachments/275a4ba4-e1ed-4050-a3b1-95f1abebdcd7 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 08:37:06.447315 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d768f7f2-15f1-4e5a-a2fb-050eac0e7563 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:37:06.447588 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d768f7f2-15f1-4e5a-a2fb-050eac0e7563 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:06.453635 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d768f7f2-15f1-4e5a-a2fb-050eac0e7563 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:06.454439 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d768f7f2-15f1-4e5a-a2fb-050eac0e7563 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:06.454861 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d768f7f2-15f1-4e5a-a2fb-050eac0e7563 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:06.455296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d768f7f2-15f1-4e5a-a2fb-050eac0e7563 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:06.545417 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d768f7f2-15f1-4e5a-a2fb-050eac0e7563 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "POST /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09/action" status: 202 len: 0 microversion: 2.20 time: 0.102949 Jul 20 08:37:06.546029 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 610/1201] 10.222.0.64 () {62 vars in 1318 bytes} [Wed Jul 20 08:37:06 2022] POST /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:37:06.555614 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f237fe82-a5ca-4b94-8ec1-9b278d2db736 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:06.556532 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f237fe82-a5ca-4b94-8ec1-9b278d2db736 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:06.565392 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f237fe82-a5ca-4b94-8ec1-9b278d2db736 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:06.566682 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f237fe82-a5ca-4b94-8ec1-9b278d2db736 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:06.567784 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f237fe82-a5ca-4b94-8ec1-9b278d2db736 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:06.570874 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f237fe82-a5ca-4b94-8ec1-9b278d2db736 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:06.745383 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-0713de5f-cc66-4d48-b586-cc9b9c6082f0 req-015ef29d-fa22-4529-acca-1c270274212b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e518b913-0606-4cd9-96f7-dfcf59ff8758", "name": "network-vif-unplugged", "status": "completed", "tag": "74d72a98-84ae-4d18-bd71-3bf590c0a455"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:37:06.765712 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-0713de5f-cc66-4d48-b586-cc9b9c6082f0 req-015ef29d-fa22-4529-acca-1c270274212b service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:06.766154 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-0713de5f-cc66-4d48-b586-cc9b9c6082f0 req-015ef29d-fa22-4529-acca-1c270274212b service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:06.792600 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-0713de5f-cc66-4d48-b586-cc9b9c6082f0 req-015ef29d-fa22-4529-acca-1c270274212b service nova] Creating event network-vif-unplugged:74d72a98-84ae-4d18-bd71-3bf590c0a455 for instance e518b913-0606-4cd9-96f7-dfcf59ff8758 on hv-cinder-82308 Jul 20 08:37:06.800392 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-0713de5f-cc66-4d48-b586-cc9b9c6082f0 req-015ef29d-fa22-4529-acca-1c270274212b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059881 Jul 20 08:37:06.807578 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 611/1202] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:37:06.816582 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1e036faa-011a-4df4-8570-b41788684881 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:06.817314 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1e036faa-011a-4df4-8570-b41788684881 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:06.836805 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1e036faa-011a-4df4-8570-b41788684881 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:06.837449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1e036faa-011a-4df4-8570-b41788684881 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:06.839334 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1e036faa-011a-4df4-8570-b41788684881 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:06.839577 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1e036faa-011a-4df4-8570-b41788684881 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:07.063016 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1e036faa-011a-4df4-8570-b41788684881 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:07.077253 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1e036faa-011a-4df4-8570-b41788684881 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1567 microversion: 2.1 time: 0.268118 Jul 20 08:37:07.078674 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 612/1203] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:06 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1567 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:07.083219 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5d7f5853-4a02-4032-9e85-94235d88aab9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:07.083966 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-5d7f5853-4a02-4032-9e85-94235d88aab9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:07.093607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5d7f5853-4a02-4032-9e85-94235d88aab9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:07.094082 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5d7f5853-4a02-4032-9e85-94235d88aab9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:07.095297 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5d7f5853-4a02-4032-9e85-94235d88aab9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:07.095737 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5d7f5853-4a02-4032-9e85-94235d88aab9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:07.158478 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f237fe82-a5ca-4b94-8ec1-9b278d2db736 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:07.167901 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f237fe82-a5ca-4b94-8ec1-9b278d2db736 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:07.169763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f237fe82-a5ca-4b94-8ec1-9b278d2db736 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:07.171199 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f237fe82-a5ca-4b94-8ec1-9b278d2db736 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1734 microversion: 2.20 time: 0.620134 Jul 20 08:37:07.171787 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 592/1204] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:06 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1734 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:37:07.530658 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5d7f5853-4a02-4032-9e85-94235d88aab9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:07.540113 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-5d7f5853-4a02-4032-9e85-94235d88aab9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1557 microversion: 2.1 time: 0.460887 Jul 20 08:37:07.540490 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 613/1205] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:07 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1557 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:07.569043 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5766b24c-8ea8-4274-ba36-c8ca11610876 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:07.570020 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5766b24c-8ea8-4274-ba36-c8ca11610876 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:07.581105 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5766b24c-8ea8-4274-ba36-c8ca11610876 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:07.582277 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5766b24c-8ea8-4274-ba36-c8ca11610876 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:07.584080 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5766b24c-8ea8-4274-ba36-c8ca11610876 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:07.587328 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5766b24c-8ea8-4274-ba36-c8ca11610876 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:07.746460 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5766b24c-8ea8-4274-ba36-c8ca11610876 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.184697 Jul 20 08:37:07.756869 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 593/1206] 10.222.0.64 () {58 vars in 1274 bytes} [Wed Jul 20 08:37:07 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef/os-interface => generated 285 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:37:07.958541 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-e7ded594-e8e0-46d4-bd4c-abd6340335a7 req-923b00ea-e3ee-478f-bfa6-e65fac31bce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e518b913-0606-4cd9-96f7-dfcf59ff8758", "name": "network-vif-deleted", "tag": "74d72a98-84ae-4d18-bd71-3bf590c0a455"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:37:07.971404 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-e7ded594-e8e0-46d4-bd4c-abd6340335a7 req-923b00ea-e3ee-478f-bfa6-e65fac31bce9 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:07.971852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-e7ded594-e8e0-46d4-bd4c-abd6340335a7 req-923b00ea-e3ee-478f-bfa6-e65fac31bce9 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:07.976795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:37:07.990326 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-e7ded594-e8e0-46d4-bd4c-abd6340335a7 req-923b00ea-e3ee-478f-bfa6-e65fac31bce9 service nova] Creating event network-vif-deleted:74d72a98-84ae-4d18-bd71-3bf590c0a455 for instance e518b913-0606-4cd9-96f7-dfcf59ff8758 on hv-cinder-82308 Jul 20 08:37:07.997626 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-e7ded594-e8e0-46d4-bd4c-abd6340335a7 req-923b00ea-e3ee-478f-bfa6-e65fac31bce9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043365 Jul 20 08:37:07.999767 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 614/1207] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:37:08.096281 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-a4820fd6-b1fb-4e29-9224-decd3532bb8d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:08.097095 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-a4820fd6-b1fb-4e29-9224-decd3532bb8d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:08.104883 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a4820fd6-b1fb-4e29-9224-decd3532bb8d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:08.105461 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a4820fd6-b1fb-4e29-9224-decd3532bb8d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:08.106318 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a4820fd6-b1fb-4e29-9224-decd3532bb8d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:08.106854 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-a4820fd6-b1fb-4e29-9224-decd3532bb8d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:08.173393 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-a4820fd6-b1fb-4e29-9224-decd3532bb8d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:08.181057 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-a4820fd6-b1fb-4e29-9224-decd3532bb8d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1218 microversion: 2.1 time: 0.089072 Jul 20 08:37:08.181876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 594/1208] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:08 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:08.191479 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e10a8590-0acf-492a-8f31-403dc62089bf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:08.192445 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-e10a8590-0acf-492a-8f31-403dc62089bf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:08.199847 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e10a8590-0acf-492a-8f31-403dc62089bf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:08.200305 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e10a8590-0acf-492a-8f31-403dc62089bf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:08.201070 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e10a8590-0acf-492a-8f31-403dc62089bf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:08.201499 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e10a8590-0acf-492a-8f31-403dc62089bf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:08.497792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e10a8590-0acf-492a-8f31-403dc62089bf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:08.506150 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e10a8590-0acf-492a-8f31-403dc62089bf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:08.507733 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e10a8590-0acf-492a-8f31-403dc62089bf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:08.508928 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e10a8590-0acf-492a-8f31-403dc62089bf tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1732 microversion: 2.20 time: 0.322098 Jul 20 08:37:08.509493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 615/1209] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:08 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1732 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:37:08.886078 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-5a226b94-dc81-40cb-b3ab-fdda55c73234 req-4393bff6-9149-4337-9e6a-2a31786cab75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c207a53a-b0d9-4d09-8ce1-beecdf160eef", "tag": "f0b4011c-e1be-4ef1-914b-9e51374f2b5f"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:37:08.896036 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-5a226b94-dc81-40cb-b3ab-fdda55c73234 req-4393bff6-9149-4337-9e6a-2a31786cab75 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:08.897021 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-5a226b94-dc81-40cb-b3ab-fdda55c73234 req-4393bff6-9149-4337-9e6a-2a31786cab75 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:08.914123 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-5a226b94-dc81-40cb-b3ab-fdda55c73234 req-4393bff6-9149-4337-9e6a-2a31786cab75 service nova] Creating event network-changed:f0b4011c-e1be-4ef1-914b-9e51374f2b5f for instance c207a53a-b0d9-4d09-8ce1-beecdf160eef on hv-cinder-82308 Jul 20 08:37:08.920581 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-5a226b94-dc81-40cb-b3ab-fdda55c73234 req-4393bff6-9149-4337-9e6a-2a31786cab75 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038478 Jul 20 08:37:08.921877 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 595/1210] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:37:09.199059 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d30b768f-af4c-4c5d-bfd6-92eb381dcea0 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:09.200626 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d30b768f-af4c-4c5d-bfd6-92eb381dcea0 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:09.208151 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d30b768f-af4c-4c5d-bfd6-92eb381dcea0 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:09.208974 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d30b768f-af4c-4c5d-bfd6-92eb381dcea0 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:09.210797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d30b768f-af4c-4c5d-bfd6-92eb381dcea0 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:09.211466 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d30b768f-af4c-4c5d-bfd6-92eb381dcea0 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:09.299200 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d30b768f-af4c-4c5d-bfd6-92eb381dcea0 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:09.308110 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d30b768f-af4c-4c5d-bfd6-92eb381dcea0 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1218 microversion: 2.1 time: 0.114225 Jul 20 08:37:09.318357 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 616/1211] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:09 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:09.530058 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-1b9e589e-1508-45d8-a6ff-91255ae53ad2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:09.530791 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-1b9e589e-1508-45d8-a6ff-91255ae53ad2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:09.550465 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1b9e589e-1508-45d8-a6ff-91255ae53ad2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:09.550953 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1b9e589e-1508-45d8-a6ff-91255ae53ad2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:09.551719 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1b9e589e-1508-45d8-a6ff-91255ae53ad2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:09.552644 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1b9e589e-1508-45d8-a6ff-91255ae53ad2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:09.751001 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1b9e589e-1508-45d8-a6ff-91255ae53ad2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:09.767313 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1b9e589e-1508-45d8-a6ff-91255ae53ad2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:09.768983 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1b9e589e-1508-45d8-a6ff-91255ae53ad2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:09.770193 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-1b9e589e-1508-45d8-a6ff-91255ae53ad2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1732 microversion: 2.20 time: 0.245474 Jul 20 08:37:09.778351 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 596/1212] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:09 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1732 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:37:10.190763 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-dd5f5920-0f0e-4a6e-bec7-7403a4cee9bb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1727826996", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-626472504", "security_groups": [{"name": "tempest-secgroup-smoke-1425617466"}], "block_device_mapping_v2": [{"uuid": "df6b201d-3c6d-4e39-92bc-64e72e628a0d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "348269a8-7968-40a5-99e7-854f19c8d583"}]}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:37:10.328101 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-aa5beec9-558c-4d34-9b1e-cd5dd6c42aad tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:10.328736 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-aa5beec9-558c-4d34-9b1e-cd5dd6c42aad tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:10.336546 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aa5beec9-558c-4d34-9b1e-cd5dd6c42aad tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:10.337577 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aa5beec9-558c-4d34-9b1e-cd5dd6c42aad tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:10.339638 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aa5beec9-558c-4d34-9b1e-cd5dd6c42aad tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:10.340884 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aa5beec9-558c-4d34-9b1e-cd5dd6c42aad tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:10.397908 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.network.neutron [None req-dd5f5920-0f0e-4a6e-bec7-7403a4cee9bb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] validate_networks() for [('348269a8-7968-40a5-99e7-854f19c8d583', None, None, None, None, None)] {{(pid=117828) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:37:10.430142 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-aa5beec9-558c-4d34-9b1e-cd5dd6c42aad tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:10.438827 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-aa5beec9-558c-4d34-9b1e-cd5dd6c42aad tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1218 microversion: 2.1 time: 0.116829 Jul 20 08:37:10.439988 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 597/1213] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:10 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:37:10.790840 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-fa956857-b366-46a4-bb43-d9fe76503721 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:10.791660 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-fa956857-b366-46a4-bb43-d9fe76503721 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:10.797894 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa956857-b366-46a4-bb43-d9fe76503721 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:10.798336 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa956857-b366-46a4-bb43-d9fe76503721 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:10.799130 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa956857-b366-46a4-bb43-d9fe76503721 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:10.799565 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa956857-b366-46a4-bb43-d9fe76503721 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:10.969715 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fa956857-b366-46a4-bb43-d9fe76503721 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:10.969886 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-dd5f5920-0f0e-4a6e-bec7-7403a4cee9bb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Flavor limits 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:37:10.969886 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-dd5f5920-0f0e-4a6e-bec7-7403a4cee9bb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Image limits 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:37:10.969886 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-dd5f5920-0f0e-4a6e-bec7-7403a4cee9bb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Flavor pref 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:37:10.969886 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-dd5f5920-0f0e-4a6e-bec7-7403a4cee9bb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Image pref 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:37:10.969886 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-dd5f5920-0f0e-4a6e-bec7-7403a4cee9bb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:37:10.978854 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fa956857-b366-46a4-bb43-d9fe76503721 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:10.980361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fa956857-b366-46a4-bb43-d9fe76503721 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:10.981477 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-dd5f5920-0f0e-4a6e-bec7-7403a4cee9bb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:10.981606 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-fa956857-b366-46a4-bb43-d9fe76503721 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1732 microversion: 2.20 time: 0.195904 Jul 20 08:37:10.982077 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 598/1214] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:10 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1732 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:37:10.982221 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-dd5f5920-0f0e-4a6e-bec7-7403a4cee9bb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:10.986502 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-dd5f5920-0f0e-4a6e-bec7-7403a4cee9bb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:10.987349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-dd5f5920-0f0e-4a6e-bec7-7403a4cee9bb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:11.012879 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-dd5f5920-0f0e-4a6e-bec7-7403a4cee9bb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Getting quotas for project fcfc8ebb18c54de29556d0b93593d676. Resources: {'cores', 'ram', 'instances'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:37:11.018713 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-dd5f5920-0f0e-4a6e-bec7-7403a4cee9bb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Getting quotas for user 19024dea6ca94745b38158beb08f29fc and project fcfc8ebb18c54de29556d0b93593d676. Resources: {'cores', 'ram', 'instances'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:37:11.080546 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-dd5f5920-0f0e-4a6e-bec7-7403a4cee9bb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Going to run 1 instances... {{(pid=117828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:37:11.082652 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-dd5f5920-0f0e-4a6e-bec7-7403a4cee9bb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='df6b201d-3c6d-4e39-92bc-64e72e628a0d',volume_size=None,volume_type=None)] {{(pid=117828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:37:11.248953 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-dd5f5920-0f0e-4a6e-bec7-7403a4cee9bb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.062009 Jul 20 08:37:11.249642 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 617/1215] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Jul 20 08:37:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 08:37:11.261231 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6f6d574a-6374-49c9-972e-9b09f520eb4d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:11.262286 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6f6d574a-6374-49c9-972e-9b09f520eb4d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:11.323760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-6f6d574a-6374-49c9-972e-9b09f520eb4d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:11.331467 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6f6d574a-6374-49c9-972e-9b09f520eb4d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1094 microversion: 2.1 time: 0.074412 Jul 20 08:37:11.333020 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 599/1216] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:11 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:11.456506 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a5ef1f02-ea40-45a7-9a75-1e27c410bbb3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:11.457765 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a5ef1f02-ea40-45a7-9a75-1e27c410bbb3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:11.469740 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a5ef1f02-ea40-45a7-9a75-1e27c410bbb3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:11.470187 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a5ef1f02-ea40-45a7-9a75-1e27c410bbb3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:11.471004 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a5ef1f02-ea40-45a7-9a75-1e27c410bbb3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:11.471437 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a5ef1f02-ea40-45a7-9a75-1e27c410bbb3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:11.553740 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a5ef1f02-ea40-45a7-9a75-1e27c410bbb3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:11.561985 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a5ef1f02-ea40-45a7-9a75-1e27c410bbb3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1218 microversion: 2.1 time: 0.109560 Jul 20 08:37:11.562560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 618/1217] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:11 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:11.966208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-491a4713-589f-465e-85a3-015536511263 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:11.966924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-491a4713-589f-465e-85a3-015536511263 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:11.973978 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-491a4713-589f-465e-85a3-015536511263 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:11.974418 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-491a4713-589f-465e-85a3-015536511263 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:11.975910 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-491a4713-589f-465e-85a3-015536511263 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:11.976753 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-491a4713-589f-465e-85a3-015536511263 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:12.001673 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-986ec80f-c0ef-4211-995e-62aac7112785 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:12.002759 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-986ec80f-c0ef-4211-995e-62aac7112785 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:12.018610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-986ec80f-c0ef-4211-995e-62aac7112785 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:12.019392 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-986ec80f-c0ef-4211-995e-62aac7112785 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:12.028106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-986ec80f-c0ef-4211-995e-62aac7112785 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:12.028740 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-986ec80f-c0ef-4211-995e-62aac7112785 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:12.029501 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-491a4713-589f-465e-85a3-015536511263 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/ips" status: 200 len: 146 microversion: 2.1 time: 0.270648 Jul 20 08:37:12.047037 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 600/1218] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Jul 20 08:37:11 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/ips => generated 146 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:37:12.267443 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-986ec80f-c0ef-4211-995e-62aac7112785 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:12.278413 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-986ec80f-c0ef-4211-995e-62aac7112785 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:12.280708 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-986ec80f-c0ef-4211-995e-62aac7112785 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:12.282030 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-986ec80f-c0ef-4211-995e-62aac7112785 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1732 microversion: 2.20 time: 0.285294 Jul 20 08:37:12.282915 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 619/1219] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:11 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1732 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:37:12.351339 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-2ef9c013-2a37-4327-8433-f3b8622f0423 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:12.352574 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-2ef9c013-2a37-4327-8433-f3b8622f0423 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:12.359908 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2ef9c013-2a37-4327-8433-f3b8622f0423 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:12.360680 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2ef9c013-2a37-4327-8433-f3b8622f0423 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:12.361647 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2ef9c013-2a37-4327-8433-f3b8622f0423 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:12.362254 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-2ef9c013-2a37-4327-8433-f3b8622f0423 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:12.457540 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-2ef9c013-2a37-4327-8433-f3b8622f0423 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:12.466428 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-2ef9c013-2a37-4327-8433-f3b8622f0423 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1144 microversion: 2.1 time: 0.119430 Jul 20 08:37:12.467048 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 601/1220] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:12 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1144 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:12.579369 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c108f93c-e873-43a2-badb-333b94fe2d3b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:12.579958 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c108f93c-e873-43a2-badb-333b94fe2d3b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:12.586260 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c108f93c-e873-43a2-badb-333b94fe2d3b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:12.586748 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c108f93c-e873-43a2-badb-333b94fe2d3b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:12.587520 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c108f93c-e873-43a2-badb-333b94fe2d3b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:12.587951 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c108f93c-e873-43a2-badb-333b94fe2d3b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:12.659019 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c108f93c-e873-43a2-badb-333b94fe2d3b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:12.667091 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c108f93c-e873-43a2-badb-333b94fe2d3b tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1218 microversion: 2.1 time: 0.091460 Jul 20 08:37:12.667990 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 620/1221] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:12 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:13.303760 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-45f0f0d4-f68f-474f-a218-73af6e11b714 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:13.304365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-45f0f0d4-f68f-474f-a218-73af6e11b714 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:13.311027 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-45f0f0d4-f68f-474f-a218-73af6e11b714 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:13.311477 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-45f0f0d4-f68f-474f-a218-73af6e11b714 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:13.312254 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-45f0f0d4-f68f-474f-a218-73af6e11b714 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:13.312688 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-45f0f0d4-f68f-474f-a218-73af6e11b714 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:13.460224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-45f0f0d4-f68f-474f-a218-73af6e11b714 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:13.468225 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-45f0f0d4-f68f-474f-a218-73af6e11b714 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:13.469694 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-45f0f0d4-f68f-474f-a218-73af6e11b714 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:13.470879 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-45f0f0d4-f68f-474f-a218-73af6e11b714 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1732 microversion: 2.20 time: 0.171711 Jul 20 08:37:13.471429 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 602/1222] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:13 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:37:13.483917 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-50210ad9-e391-45a0-9d76-16b0065f9b51 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:13.484524 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-50210ad9-e391-45a0-9d76-16b0065f9b51 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:13.491926 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-50210ad9-e391-45a0-9d76-16b0065f9b51 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:13.492367 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-50210ad9-e391-45a0-9d76-16b0065f9b51 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:13.493127 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-50210ad9-e391-45a0-9d76-16b0065f9b51 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:13.493552 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-50210ad9-e391-45a0-9d76-16b0065f9b51 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:13.558633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-50210ad9-e391-45a0-9d76-16b0065f9b51 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:13.567694 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-50210ad9-e391-45a0-9d76-16b0065f9b51 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1144 microversion: 2.1 time: 0.087461 Jul 20 08:37:13.577868 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 621/1223] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:13 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1144 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:13.685447 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-15155133-da39-40cf-b9f4-a47fe14ad906 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:13.686052 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-15155133-da39-40cf-b9f4-a47fe14ad906 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:13.693131 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-15155133-da39-40cf-b9f4-a47fe14ad906 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:13.693660 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-15155133-da39-40cf-b9f4-a47fe14ad906 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:13.694643 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-15155133-da39-40cf-b9f4-a47fe14ad906 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:13.695084 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-15155133-da39-40cf-b9f4-a47fe14ad906 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:13.759306 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-15155133-da39-40cf-b9f4-a47fe14ad906 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:13.767277 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-15155133-da39-40cf-b9f4-a47fe14ad906 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1218 microversion: 2.1 time: 0.085630 Jul 20 08:37:13.767853 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 603/1224] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:13 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:14.489215 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1990519e-bae5-4476-823b-62a606bdae5c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:14.489811 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1990519e-bae5-4476-823b-62a606bdae5c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:14.498270 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1990519e-bae5-4476-823b-62a606bdae5c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:14.498742 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1990519e-bae5-4476-823b-62a606bdae5c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:14.499700 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1990519e-bae5-4476-823b-62a606bdae5c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:14.500130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1990519e-bae5-4476-823b-62a606bdae5c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:14.543708 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8ebaea10-270c-4ae9-ba31-cea1b1af92fc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61e9981c-236c-424e-ac19-a12fa414ae93"}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:37:14.544776 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8ebaea10-270c-4ae9-ba31-cea1b1af92fc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:14.551599 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8ebaea10-270c-4ae9-ba31-cea1b1af92fc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:14.553465 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8ebaea10-270c-4ae9-ba31-cea1b1af92fc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:14.553615 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8ebaea10-270c-4ae9-ba31-cea1b1af92fc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:14.554035 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8ebaea10-270c-4ae9-ba31-cea1b1af92fc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:14.698303 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1990519e-bae5-4476-823b-62a606bdae5c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:14.712287 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1990519e-bae5-4476-823b-62a606bdae5c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:14.715107 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1990519e-bae5-4476-823b-62a606bdae5c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:14.717152 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1990519e-bae5-4476-823b-62a606bdae5c tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1732 microversion: 2.20 time: 0.231517 Jul 20 08:37:14.718171 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 622/1225] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:14 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1732 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:37:14.725012 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7de9b1d4-3593-4aaf-95d5-4011e1e293a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:14.726016 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-7de9b1d4-3593-4aaf-95d5-4011e1e293a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:14.738445 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7de9b1d4-3593-4aaf-95d5-4011e1e293a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:14.739405 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7de9b1d4-3593-4aaf-95d5-4011e1e293a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:14.747584 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7de9b1d4-3593-4aaf-95d5-4011e1e293a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:14.748190 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7de9b1d4-3593-4aaf-95d5-4011e1e293a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:14.820031 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-7de9b1d4-3593-4aaf-95d5-4011e1e293a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:14.833495 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-7de9b1d4-3593-4aaf-95d5-4011e1e293a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1144 microversion: 2.1 time: 0.113457 Jul 20 08:37:14.834984 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 623/1226] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:14 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1144 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:14.842422 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9dd93883-d6a5-409e-92c4-13a068096fd3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:14.843235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9dd93883-d6a5-409e-92c4-13a068096fd3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:14.851311 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9dd93883-d6a5-409e-92c4-13a068096fd3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:14.852166 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9dd93883-d6a5-409e-92c4-13a068096fd3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:14.853625 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9dd93883-d6a5-409e-92c4-13a068096fd3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:14.854470 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9dd93883-d6a5-409e-92c4-13a068096fd3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:14.931509 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-9dd93883-d6a5-409e-92c4-13a068096fd3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:14.939312 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9dd93883-d6a5-409e-92c4-13a068096fd3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1218 microversion: 2.1 time: 0.102846 Jul 20 08:37:14.939914 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 624/1227] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:14 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:15.740504 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-086d0537-64f5-4c50-93a3-acd802997d21 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:15.741970 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-086d0537-64f5-4c50-93a3-acd802997d21 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:15.747468 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-086d0537-64f5-4c50-93a3-acd802997d21 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:15.747920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-086d0537-64f5-4c50-93a3-acd802997d21 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:15.748689 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-086d0537-64f5-4c50-93a3-acd802997d21 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:15.749155 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-086d0537-64f5-4c50-93a3-acd802997d21 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:15.896407 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-086d0537-64f5-4c50-93a3-acd802997d21 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:15.905257 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-086d0537-64f5-4c50-93a3-acd802997d21 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:15.906710 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-086d0537-64f5-4c50-93a3-acd802997d21 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:15.907908 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-086d0537-64f5-4c50-93a3-acd802997d21 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1732 microversion: 2.20 time: 0.171993 Jul 20 08:37:15.914846 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 625/1228] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:15 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1732 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:37:15.914846 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-951b3058-55e6-4b17-ac11-5d0e6fcd18b5 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:15.914846 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-951b3058-55e6-4b17-ac11-5d0e6fcd18b5 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:15.931338 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-951b3058-55e6-4b17-ac11-5d0e6fcd18b5 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:15.932053 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-951b3058-55e6-4b17-ac11-5d0e6fcd18b5 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:15.933011 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-951b3058-55e6-4b17-ac11-5d0e6fcd18b5 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:15.933612 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-951b3058-55e6-4b17-ac11-5d0e6fcd18b5 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:16.005304 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-951b3058-55e6-4b17-ac11-5d0e6fcd18b5 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:16.017207 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-951b3058-55e6-4b17-ac11-5d0e6fcd18b5 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1144 microversion: 2.1 time: 0.107534 Jul 20 08:37:16.018195 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 626/1229] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:15 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1144 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:16.024066 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f52b1e32-1642-40c8-be68-14b6d2a3b4a3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:16.024683 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f52b1e32-1642-40c8-be68-14b6d2a3b4a3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:16.033012 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f52b1e32-1642-40c8-be68-14b6d2a3b4a3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:16.033572 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f52b1e32-1642-40c8-be68-14b6d2a3b4a3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:16.034392 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f52b1e32-1642-40c8-be68-14b6d2a3b4a3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:16.034862 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f52b1e32-1642-40c8-be68-14b6d2a3b4a3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:16.103281 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f52b1e32-1642-40c8-be68-14b6d2a3b4a3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:16.111373 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f52b1e32-1642-40c8-be68-14b6d2a3b4a3 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1218 microversion: 2.1 time: 0.092037 Jul 20 08:37:16.111947 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 627/1230] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:16 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:16.930649 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-2cdfa0f8-cf03-45b2-9ec3-38d2b1144d2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:16.931368 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-2cdfa0f8-cf03-45b2-9ec3-38d2b1144d2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:16.937987 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2cdfa0f8-cf03-45b2-9ec3-38d2b1144d2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:16.938430 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2cdfa0f8-cf03-45b2-9ec3-38d2b1144d2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:16.939321 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2cdfa0f8-cf03-45b2-9ec3-38d2b1144d2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:16.939755 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-2cdfa0f8-cf03-45b2-9ec3-38d2b1144d2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:17.111795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2cdfa0f8-cf03-45b2-9ec3-38d2b1144d2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:17.120239 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2cdfa0f8-cf03-45b2-9ec3-38d2b1144d2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:17.121756 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-2cdfa0f8-cf03-45b2-9ec3-38d2b1144d2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:17.131245 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-2cdfa0f8-cf03-45b2-9ec3-38d2b1144d2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1732 microversion: 2.20 time: 0.196777 Jul 20 08:37:17.131897 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 628/1231] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:16 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1732 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:37:17.137161 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-63902648-1372-463f-a41c-cbf0824eb757 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:17.137868 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-63902648-1372-463f-a41c-cbf0824eb757 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:17.144539 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-63902648-1372-463f-a41c-cbf0824eb757 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:17.144993 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-63902648-1372-463f-a41c-cbf0824eb757 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:17.145776 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-63902648-1372-463f-a41c-cbf0824eb757 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:17.146212 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-63902648-1372-463f-a41c-cbf0824eb757 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:17.209008 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-63902648-1372-463f-a41c-cbf0824eb757 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:17.217662 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-63902648-1372-463f-a41c-cbf0824eb757 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1144 microversion: 2.1 time: 0.084710 Jul 20 08:37:17.218253 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 629/1232] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:17 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:17.222784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-42a68f6c-7936-45fa-a160-bb692063d63d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:17.223382 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-42a68f6c-7936-45fa-a160-bb692063d63d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:17.229573 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-42a68f6c-7936-45fa-a160-bb692063d63d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:17.230018 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-42a68f6c-7936-45fa-a160-bb692063d63d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:17.230818 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-42a68f6c-7936-45fa-a160-bb692063d63d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:17.231256 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-42a68f6c-7936-45fa-a160-bb692063d63d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:17.302220 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-42a68f6c-7936-45fa-a160-bb692063d63d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:17.310152 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-42a68f6c-7936-45fa-a160-bb692063d63d tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1218 microversion: 2.1 time: 0.090927 Jul 20 08:37:17.310741 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 630/1233] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:17 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:18.154249 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e912fbe7-b048-4632-bcb6-c466aff248b9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:18.155484 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-e912fbe7-b048-4632-bcb6-c466aff248b9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:18.168850 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e912fbe7-b048-4632-bcb6-c466aff248b9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:18.169801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e912fbe7-b048-4632-bcb6-c466aff248b9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:18.171150 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e912fbe7-b048-4632-bcb6-c466aff248b9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:18.171787 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e912fbe7-b048-4632-bcb6-c466aff248b9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:18.343812 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e912fbe7-b048-4632-bcb6-c466aff248b9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:18.355484 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e912fbe7-b048-4632-bcb6-c466aff248b9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:18.356993 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e912fbe7-b048-4632-bcb6-c466aff248b9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:18.358158 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e912fbe7-b048-4632-bcb6-c466aff248b9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1732 microversion: 2.20 time: 0.210086 Jul 20 08:37:18.358755 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 631/1234] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:18 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1732 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:37:18.364463 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-bdb627a4-da5d-4959-a620-c365f8b766e2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:18.365064 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-bdb627a4-da5d-4959-a620-c365f8b766e2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:18.373296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bdb627a4-da5d-4959-a620-c365f8b766e2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:18.373748 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bdb627a4-da5d-4959-a620-c365f8b766e2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:18.374524 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bdb627a4-da5d-4959-a620-c365f8b766e2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:18.375005 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bdb627a4-da5d-4959-a620-c365f8b766e2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:18.379321 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=100 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:37:18.449464 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-bdb627a4-da5d-4959-a620-c365f8b766e2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:18.460186 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-bdb627a4-da5d-4959-a620-c365f8b766e2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1144 microversion: 2.1 time: 0.099937 Jul 20 08:37:18.460904 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 632/1235] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:18 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1144 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:18.469809 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f011f3f2-0d49-4e97-9d8a-e64460e86c73 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:18.471058 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f011f3f2-0d49-4e97-9d8a-e64460e86c73 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:18.476853 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:37:18.483011 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f011f3f2-0d49-4e97-9d8a-e64460e86c73 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:18.483659 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f011f3f2-0d49-4e97-9d8a-e64460e86c73 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:18.484844 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f011f3f2-0d49-4e97-9d8a-e64460e86c73 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:18.485446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f011f3f2-0d49-4e97-9d8a-e64460e86c73 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:18.564646 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f011f3f2-0d49-4e97-9d8a-e64460e86c73 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:18.574375 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f011f3f2-0d49-4e97-9d8a-e64460e86c73 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1218 microversion: 2.1 time: 0.111636 Jul 20 08:37:18.575316 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 633/1236] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:18 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:19.376431 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0bc84ab3-11c5-4aa1-8f32-e1af54f150e8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:19.377198 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0bc84ab3-11c5-4aa1-8f32-e1af54f150e8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:19.384776 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0bc84ab3-11c5-4aa1-8f32-e1af54f150e8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:19.385326 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0bc84ab3-11c5-4aa1-8f32-e1af54f150e8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:19.386125 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0bc84ab3-11c5-4aa1-8f32-e1af54f150e8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:19.386567 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0bc84ab3-11c5-4aa1-8f32-e1af54f150e8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:19.533316 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-0bc84ab3-11c5-4aa1-8f32-e1af54f150e8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:19.542570 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-0bc84ab3-11c5-4aa1-8f32-e1af54f150e8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:19.544118 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-0bc84ab3-11c5-4aa1-8f32-e1af54f150e8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:19.545282 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0bc84ab3-11c5-4aa1-8f32-e1af54f150e8 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1732 microversion: 2.20 time: 0.172909 Jul 20 08:37:19.545841 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 634/1237] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:19 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:37:19.550406 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-18f6f658-e67f-4ef5-9b99-60aff1ad6eea tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:19.551029 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-18f6f658-e67f-4ef5-9b99-60aff1ad6eea tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:19.557772 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-18f6f658-e67f-4ef5-9b99-60aff1ad6eea tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:19.558219 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-18f6f658-e67f-4ef5-9b99-60aff1ad6eea tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:19.559021 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-18f6f658-e67f-4ef5-9b99-60aff1ad6eea tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:19.559459 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-18f6f658-e67f-4ef5-9b99-60aff1ad6eea tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:19.636786 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-18f6f658-e67f-4ef5-9b99-60aff1ad6eea tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:19.645319 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-18f6f658-e67f-4ef5-9b99-60aff1ad6eea tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1144 microversion: 2.1 time: 0.098337 Jul 20 08:37:19.647393 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 635/1238] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:19 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1144 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:19.651293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-59297b22-4438-4a42-b02b-5b9dd6fa9a55 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:19.652121 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-59297b22-4438-4a42-b02b-5b9dd6fa9a55 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:19.659180 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-59297b22-4438-4a42-b02b-5b9dd6fa9a55 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:19.659632 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-59297b22-4438-4a42-b02b-5b9dd6fa9a55 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:19.660405 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-59297b22-4438-4a42-b02b-5b9dd6fa9a55 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:19.660859 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-59297b22-4438-4a42-b02b-5b9dd6fa9a55 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:19.722907 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-59297b22-4438-4a42-b02b-5b9dd6fa9a55 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:19.731435 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-59297b22-4438-4a42-b02b-5b9dd6fa9a55 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1218 microversion: 2.1 time: 0.083654 Jul 20 08:37:19.732050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 636/1239] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:19 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:20.564267 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-46493e2e-94fa-49d3-8041-0eb9646553d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:20.564944 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-46493e2e-94fa-49d3-8041-0eb9646553d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:20.572094 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-46493e2e-94fa-49d3-8041-0eb9646553d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:20.572548 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-46493e2e-94fa-49d3-8041-0eb9646553d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:20.573312 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-46493e2e-94fa-49d3-8041-0eb9646553d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:20.573748 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-46493e2e-94fa-49d3-8041-0eb9646553d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:20.708634 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-46493e2e-94fa-49d3-8041-0eb9646553d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:20.717022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-46493e2e-94fa-49d3-8041-0eb9646553d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:20.718512 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-46493e2e-94fa-49d3-8041-0eb9646553d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:20.719691 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-46493e2e-94fa-49d3-8041-0eb9646553d9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1732 microversion: 2.20 time: 0.159434 Jul 20 08:37:20.720246 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 637/1240] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:20 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:37:20.724644 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b406aeee-a8ab-4472-b4fd-8571dc5fec3a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:20.725368 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b406aeee-a8ab-4472-b4fd-8571dc5fec3a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:20.731197 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b406aeee-a8ab-4472-b4fd-8571dc5fec3a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:20.731648 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b406aeee-a8ab-4472-b4fd-8571dc5fec3a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:20.732472 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b406aeee-a8ab-4472-b4fd-8571dc5fec3a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:20.732970 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b406aeee-a8ab-4472-b4fd-8571dc5fec3a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:20.794565 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b406aeee-a8ab-4472-b4fd-8571dc5fec3a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:20.802053 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b406aeee-a8ab-4472-b4fd-8571dc5fec3a tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1144 microversion: 2.1 time: 0.080874 Jul 20 08:37:20.803216 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 638/1241] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:20 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:20.807806 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c30e5c11-5ef0-4c40-ac23-fe63fbe9b665 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:20.808408 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c30e5c11-5ef0-4c40-ac23-fe63fbe9b665 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:20.814092 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c30e5c11-5ef0-4c40-ac23-fe63fbe9b665 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:20.814590 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c30e5c11-5ef0-4c40-ac23-fe63fbe9b665 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:20.815339 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c30e5c11-5ef0-4c40-ac23-fe63fbe9b665 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:20.815776 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c30e5c11-5ef0-4c40-ac23-fe63fbe9b665 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:20.879194 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c30e5c11-5ef0-4c40-ac23-fe63fbe9b665 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:20.886925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c30e5c11-5ef0-4c40-ac23-fe63fbe9b665 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1218 microversion: 2.1 time: 0.082601 Jul 20 08:37:20.887493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 639/1242] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:20 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:21.331726 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=2 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:37:21.738920 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-aebc5d76-c86a-4b67-957b-55f120ff63f2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:21.739646 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-aebc5d76-c86a-4b67-957b-55f120ff63f2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:21.742084 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=2 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:37:21.742850 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=6 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:37:21.749245 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aebc5d76-c86a-4b67-957b-55f120ff63f2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:21.749681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aebc5d76-c86a-4b67-957b-55f120ff63f2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:21.750451 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aebc5d76-c86a-4b67-957b-55f120ff63f2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:21.750898 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aebc5d76-c86a-4b67-957b-55f120ff63f2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:21.891233 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-aebc5d76-c86a-4b67-957b-55f120ff63f2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:21.900225 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-aebc5d76-c86a-4b67-957b-55f120ff63f2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:21.901741 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-aebc5d76-c86a-4b67-957b-55f120ff63f2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:21.902933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-aebc5d76-c86a-4b67-957b-55f120ff63f2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1732 microversion: 2.20 time: 0.168701 Jul 20 08:37:21.903489 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 640/1243] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:21 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:37:21.907846 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c30a5ba8-82e5-430c-a519-3c573a02cf7f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:21.908487 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c30a5ba8-82e5-430c-a519-3c573a02cf7f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:21.914683 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c30a5ba8-82e5-430c-a519-3c573a02cf7f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:21.915134 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c30a5ba8-82e5-430c-a519-3c573a02cf7f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:21.915914 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c30a5ba8-82e5-430c-a519-3c573a02cf7f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:21.916348 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c30a5ba8-82e5-430c-a519-3c573a02cf7f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:21.979670 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c30a5ba8-82e5-430c-a519-3c573a02cf7f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:21.987752 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c30a5ba8-82e5-430c-a519-3c573a02cf7f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1144 microversion: 2.1 time: 0.083296 Jul 20 08:37:21.988315 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 641/1244] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:21 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:21.992930 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8ce8e03b-6388-434c-ac22-f85dcea2a5fc tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:21.993646 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8ce8e03b-6388-434c-ac22-f85dcea2a5fc tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:21.999958 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8ce8e03b-6388-434c-ac22-f85dcea2a5fc tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:22.000388 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8ce8e03b-6388-434c-ac22-f85dcea2a5fc tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:22.001135 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8ce8e03b-6388-434c-ac22-f85dcea2a5fc tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:22.001555 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8ce8e03b-6388-434c-ac22-f85dcea2a5fc tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:22.063840 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-8ce8e03b-6388-434c-ac22-f85dcea2a5fc tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:22.072063 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8ce8e03b-6388-434c-ac22-f85dcea2a5fc tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1218 microversion: 2.1 time: 0.082802 Jul 20 08:37:22.072646 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 642/1245] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:21 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:22.921635 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-70d2f9be-3985-4ce0-b085-c5bf3bdffa6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:22.922292 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-70d2f9be-3985-4ce0-b085-c5bf3bdffa6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:22.928539 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-70d2f9be-3985-4ce0-b085-c5bf3bdffa6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:22.928995 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-70d2f9be-3985-4ce0-b085-c5bf3bdffa6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:22.929781 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-70d2f9be-3985-4ce0-b085-c5bf3bdffa6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:22.930216 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-70d2f9be-3985-4ce0-b085-c5bf3bdffa6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:23.073533 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-70d2f9be-3985-4ce0-b085-c5bf3bdffa6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:23.081506 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-70d2f9be-3985-4ce0-b085-c5bf3bdffa6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:23.083272 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-70d2f9be-3985-4ce0-b085-c5bf3bdffa6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:23.085130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-70d2f9be-3985-4ce0-b085-c5bf3bdffa6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1732 microversion: 2.20 time: 0.167647 Jul 20 08:37:23.085694 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 643/1246] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:22 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:37:23.090220 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-fcd36d40-3eb3-4b86-9997-27db33227725 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:23.090840 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-fcd36d40-3eb3-4b86-9997-27db33227725 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:23.096762 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fcd36d40-3eb3-4b86-9997-27db33227725 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:23.097233 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fcd36d40-3eb3-4b86-9997-27db33227725 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:23.097978 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fcd36d40-3eb3-4b86-9997-27db33227725 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:23.098412 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fcd36d40-3eb3-4b86-9997-27db33227725 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:23.163977 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-fcd36d40-3eb3-4b86-9997-27db33227725 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:23.171417 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-fcd36d40-3eb3-4b86-9997-27db33227725 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1144 microversion: 2.1 time: 0.084719 Jul 20 08:37:23.172032 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 644/1247] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:23 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:23.176464 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b922c591-5d0c-4c90-9b2a-58bc553143a4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:23.177057 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b922c591-5d0c-4c90-9b2a-58bc553143a4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:23.183297 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b922c591-5d0c-4c90-9b2a-58bc553143a4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:23.183739 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b922c591-5d0c-4c90-9b2a-58bc553143a4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:23.184494 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b922c591-5d0c-4c90-9b2a-58bc553143a4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:23.184923 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b922c591-5d0c-4c90-9b2a-58bc553143a4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:23.246257 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b922c591-5d0c-4c90-9b2a-58bc553143a4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:23.253859 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b922c591-5d0c-4c90-9b2a-58bc553143a4 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1218 microversion: 2.1 time: 0.080884 Jul 20 08:37:23.254424 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 645/1248] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:23 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:24.104174 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0cec2b88-6168-483d-ada5-15addc75f4c1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:24.104887 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0cec2b88-6168-483d-ada5-15addc75f4c1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:24.111485 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0cec2b88-6168-483d-ada5-15addc75f4c1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:24.111934 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0cec2b88-6168-483d-ada5-15addc75f4c1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:24.112714 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0cec2b88-6168-483d-ada5-15addc75f4c1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:24.113147 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0cec2b88-6168-483d-ada5-15addc75f4c1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:24.275728 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-0cec2b88-6168-483d-ada5-15addc75f4c1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:24.285067 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-0cec2b88-6168-483d-ada5-15addc75f4c1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:24.286658 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-0cec2b88-6168-483d-ada5-15addc75f4c1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:24.288413 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0cec2b88-6168-483d-ada5-15addc75f4c1 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1732 microversion: 2.20 time: 0.188739 Jul 20 08:37:24.289088 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 646/1249] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:24 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:37:24.293897 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5b66c154-c74c-4cba-b266-993ba786ff32 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:24.294508 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-5b66c154-c74c-4cba-b266-993ba786ff32 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:24.301556 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5b66c154-c74c-4cba-b266-993ba786ff32 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:24.301908 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5b66c154-c74c-4cba-b266-993ba786ff32 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:24.303289 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5b66c154-c74c-4cba-b266-993ba786ff32 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:24.303853 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5b66c154-c74c-4cba-b266-993ba786ff32 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:24.373616 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5b66c154-c74c-4cba-b266-993ba786ff32 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:24.381605 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-5b66c154-c74c-4cba-b266-993ba786ff32 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1144 microversion: 2.1 time: 0.091418 Jul 20 08:37:24.382203 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 647/1250] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:24 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:24.386945 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c93e9f14-c304-4045-8bfa-13937e1568ca tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:24.387559 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c93e9f14-c304-4045-8bfa-13937e1568ca tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:24.394485 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c93e9f14-c304-4045-8bfa-13937e1568ca tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:24.394969 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c93e9f14-c304-4045-8bfa-13937e1568ca tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:24.395751 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c93e9f14-c304-4045-8bfa-13937e1568ca tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:24.396722 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c93e9f14-c304-4045-8bfa-13937e1568ca tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:24.466097 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c93e9f14-c304-4045-8bfa-13937e1568ca tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:24.469738 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=100 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:37:24.475377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c93e9f14-c304-4045-8bfa-13937e1568ca tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1218 microversion: 2.1 time: 0.091421 Jul 20 08:37:24.476427 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 648/1251] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:24 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:24.549345 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=63 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:37:24.664320 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:37:25.314343 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-abcc29f3-f73b-4636-b401-a16f2d41a397 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:25.314993 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-abcc29f3-f73b-4636-b401-a16f2d41a397 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:25.321846 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-abcc29f3-f73b-4636-b401-a16f2d41a397 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:25.322298 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-abcc29f3-f73b-4636-b401-a16f2d41a397 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:25.323109 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-abcc29f3-f73b-4636-b401-a16f2d41a397 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:25.323772 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-abcc29f3-f73b-4636-b401-a16f2d41a397 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:25.456769 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-abcc29f3-f73b-4636-b401-a16f2d41a397 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:25.465226 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-abcc29f3-f73b-4636-b401-a16f2d41a397 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:25.466753 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-abcc29f3-f73b-4636-b401-a16f2d41a397 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:25.467905 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-abcc29f3-f73b-4636-b401-a16f2d41a397 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1732 microversion: 2.20 time: 0.157822 Jul 20 08:37:25.468476 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 649/1252] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:25 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:37:25.473224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d0623023-855a-473c-8b6c-d153bf1dad1c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:25.473818 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d0623023-855a-473c-8b6c-d153bf1dad1c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:25.479862 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d0623023-855a-473c-8b6c-d153bf1dad1c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:25.480312 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d0623023-855a-473c-8b6c-d153bf1dad1c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:25.481078 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d0623023-855a-473c-8b6c-d153bf1dad1c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:25.481515 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d0623023-855a-473c-8b6c-d153bf1dad1c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:25.558338 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d0623023-855a-473c-8b6c-d153bf1dad1c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:25.567312 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d0623023-855a-473c-8b6c-d153bf1dad1c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1144 microversion: 2.1 time: 0.097704 Jul 20 08:37:25.567821 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 650/1253] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:25 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1144 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:25.573607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d348db85-ecf7-4341-ab10-5d28cef84e3c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:25.574334 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d348db85-ecf7-4341-ab10-5d28cef84e3c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:25.580576 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d348db85-ecf7-4341-ab10-5d28cef84e3c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:25.581082 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d348db85-ecf7-4341-ab10-5d28cef84e3c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:25.581783 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d348db85-ecf7-4341-ab10-5d28cef84e3c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:25.582251 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d348db85-ecf7-4341-ab10-5d28cef84e3c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:25.658674 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-d348db85-ecf7-4341-ab10-5d28cef84e3c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:25.666485 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d348db85-ecf7-4341-ab10-5d28cef84e3c tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1218 microversion: 2.1 time: 0.097067 Jul 20 08:37:25.667085 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 651/1254] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:25 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:26.491366 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-fe092a6c-f28d-443a-a883-cdd86fb74277 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:26.492548 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-fe092a6c-f28d-443a-a883-cdd86fb74277 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:26.506899 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fe092a6c-f28d-443a-a883-cdd86fb74277 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:26.508104 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fe092a6c-f28d-443a-a883-cdd86fb74277 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:26.509571 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fe092a6c-f28d-443a-a883-cdd86fb74277 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:26.510369 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fe092a6c-f28d-443a-a883-cdd86fb74277 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:26.593670 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8ebaea10-270c-4ae9-ba31-cea1b1af92fc tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "POST /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.053138 Jul 20 08:37:26.596519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 604/1255] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Jul 20 08:37:14 2022] POST /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments => generated 194 bytes in 12058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:37:26.608734 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-82366650-d255-4cc5-a007-7de4c332147b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:26.610199 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-82366650-d255-4cc5-a007-7de4c332147b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:26.629525 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-82366650-d255-4cc5-a007-7de4c332147b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:26.630932 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-82366650-d255-4cc5-a007-7de4c332147b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:26.633770 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-82366650-d255-4cc5-a007-7de4c332147b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:26.634606 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-82366650-d255-4cc5-a007-7de4c332147b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:26.744061 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-82366650-d255-4cc5-a007-7de4c332147b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:26.750105 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-fe092a6c-f28d-443a-a883-cdd86fb74277 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:26.756258 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-82366650-d255-4cc5-a007-7de4c332147b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1192 microversion: 2.1 time: 0.157377 Jul 20 08:37:26.757092 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 605/1256] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:26 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1192 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:26.770733 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-59792017-4afe-4577-98d4-6f071962dd20 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:26.771385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-59792017-4afe-4577-98d4-6f071962dd20 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:26.774807 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-fe092a6c-f28d-443a-a883-cdd86fb74277 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:26.776784 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-fe092a6c-f28d-443a-a883-cdd86fb74277 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:26.779124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-fe092a6c-f28d-443a-a883-cdd86fb74277 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1732 microversion: 2.20 time: 0.297241 Jul 20 08:37:26.786641 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-59792017-4afe-4577-98d4-6f071962dd20 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:26.787049 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 652/1257] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:26 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1732 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:37:26.789976 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-59792017-4afe-4577-98d4-6f071962dd20 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:26.791187 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-59792017-4afe-4577-98d4-6f071962dd20 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:26.791944 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-59792017-4afe-4577-98d4-6f071962dd20 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:26.846360 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-59792017-4afe-4577-98d4-6f071962dd20 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:26.846879 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-59792017-4afe-4577-98d4-6f071962dd20 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:26.847298 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.objects.instance [None req-59792017-4afe-4577-98d4-6f071962dd20 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lazy-loading 'fault' on Instance uuid e518b913-0606-4cd9-96f7-dfcf59ff8758 {{(pid=117829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:37:26.890777 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-59792017-4afe-4577-98d4-6f071962dd20 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3ca706dfed4770a1eef107b28a9233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '714941c1e0034a37b0bf0144c1eac958', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:26.899196 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-59792017-4afe-4577-98d4-6f071962dd20 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 200 len: 1223 microversion: 2.1 time: 0.140925 Jul 20 08:37:26.899769 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 606/1258] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:26 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 1223 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:27.778218 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-e36ef614-b7de-43ea-a0f2-2cdb67c97dc1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:27.778875 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-e36ef614-b7de-43ea-a0f2-2cdb67c97dc1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:27.785799 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e36ef614-b7de-43ea-a0f2-2cdb67c97dc1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:27.786239 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e36ef614-b7de-43ea-a0f2-2cdb67c97dc1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:27.787612 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e36ef614-b7de-43ea-a0f2-2cdb67c97dc1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:27.788361 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-e36ef614-b7de-43ea-a0f2-2cdb67c97dc1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:27.798614 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c1a33295-ef3a-4d56-b2bb-a2ce201480a6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:27.799281 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c1a33295-ef3a-4d56-b2bb-a2ce201480a6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:27.807129 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c1a33295-ef3a-4d56-b2bb-a2ce201480a6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:27.807566 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c1a33295-ef3a-4d56-b2bb-a2ce201480a6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:27.808644 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c1a33295-ef3a-4d56-b2bb-a2ce201480a6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:27.809063 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c1a33295-ef3a-4d56-b2bb-a2ce201480a6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:27.866711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-e36ef614-b7de-43ea-a0f2-2cdb67c97dc1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:27.875426 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-e36ef614-b7de-43ea-a0f2-2cdb67c97dc1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1210 microversion: 2.1 time: 0.102915 Jul 20 08:37:27.876004 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 653/1259] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:27 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:37:27.921069 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d8704584-9c11-453d-9bf0-693df86a2769 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:27.923344 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d8704584-9c11-453d-9bf0-693df86a2769 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] [instance: e518b913-0606-4cd9-96f7-dfcf59ff8758] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:27.935281 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d8704584-9c11-453d-9bf0-693df86a2769 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:27.936016 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d8704584-9c11-453d-9bf0-693df86a2769 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:27.937255 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d8704584-9c11-453d-9bf0-693df86a2769 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:27.937706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d8704584-9c11-453d-9bf0-693df86a2769 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:27.953936 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-d8704584-9c11-453d-9bf0-693df86a2769 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] HTTP exception thrown: Instance e518b913-0606-4cd9-96f7-dfcf59ff8758 could not be found. Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d8704584-9c11-453d-9bf0-693df86a2769 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Request method failure captured: Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 HTTP/1.1 Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi170LKVDRgFeqsR534qz-uNKX16owgdDmhyhfm6INal60gAvS4dptrPZJ61aFCBqpnRpbkx2st76-NUDQjo4EhUapr9ki4lgi9Jf-tSTKEZ1-j28QX1g9plp7_EOT3u2oyRZ7VPtfYdDACfg0qp5q7NcVQnI7gsTcLFjQXBGJu2ZCWjI Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: 714941c1e0034a37b0bf0144c1eac958 Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-TestShelveInstance-281246124 Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:37:27.956461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:37:27.958224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/714941c1e0034a37b0bf0144c1eac958"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/714941c1e0034a37b0bf0144c1eac958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_714941c1e0034a37b0bf0144c1eac958", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/714941c1e0034a37b0bf0144c1eac958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:37:27.958224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-TestShelveInstance-281246124 Jul 20 08:37:27.958224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: 714941c1e0034a37b0bf0144c1eac958 Jul 20 08:37:27.958224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-TestShelveInstance-281246124 Jul 20 08:37:27.958224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-TestShelveInstance-281246124-project Jul 20 08:37:27.958224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:37:27.958224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:37:27.958224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: 9c3ca706dfed4770a1eef107b28a9233 Jul 20 08:37:27.958224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-TestShelveInstance-281246124-project Jul 20 08:37:27.958224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:37:27.958224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance e518b913-0606-4cd9-96f7-dfcf59ff8758 could not be found. Jul 20 08:37:27.958224 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': 'e518b913-0606-4cd9-96f7-dfcf59ff8758'} Jul 20 08:37:27.959248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:37:27.959248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:37:27.959248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:37:27.959248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:37:27.959248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:37:27.959248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:37:27.959248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:37:27.959248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:37:27.959248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:37:27.959248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:37:27.959248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e518b913-0606-4cd9-96f7-dfcf59ff8758 could not be found. Jul 20 08:37:27.959248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:37:27.959248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:37:27.959248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:37:27.959248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:37:27.959248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:37:27.959248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:37:27.959248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:37:27.959248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:37:27.959248 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:37:27.961483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:37:27.961483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:37:27.961483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:37:27.961483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:37:27.961483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:37:27.961483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:37:27.961483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:37:27.961483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e518b913-0606-4cd9-96f7-dfcf59ff8758 could not be found. Jul 20 08:37:27.961483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:37:27.961483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:37:27.961483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:37:27.961483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:37:27.961483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:37:27.961483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:37:27.961483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:37:27.961483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:37:27.961483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e518b913-0606-4cd9-96f7-dfcf59ff8758 could not be found. Jul 20 08:37:27.961483 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:37:27.963472 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d8704584-9c11-453d-9bf0-693df86a2769 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Returning 404 to user: Instance e518b913-0606-4cd9-96f7-dfcf59ff8758 could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:37:27.963472 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d8704584-9c11-453d-9bf0-693df86a2769 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758" status: 404 len: 111 microversion: 2.1 time: 0.044356 Jul 20 08:37:27.963472 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 654/1260] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:27 2022] GET /compute/v2.1/servers/e518b913-0606-4cd9-96f7-dfcf59ff8758 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:37:28.044561 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c1a33295-ef3a-4d56-b2bb-a2ce201480a6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:28.056210 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c1a33295-ef3a-4d56-b2bb-a2ce201480a6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:28.058013 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-c1a33295-ef3a-4d56-b2bb-a2ce201480a6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:28.059357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c1a33295-ef3a-4d56-b2bb-a2ce201480a6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1732 microversion: 2.20 time: 0.264696 Jul 20 08:37:28.060346 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 607/1261] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:27 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1732 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:37:28.164978 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-edeeb928-64dd-4b23-9cc1-efcbd5864230 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] Calling method '.version_select at 0x7fe39939dca0>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:28.191841 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-edeeb928-64dd-4b23-9cc1-efcbd5864230 tempest-TestShelveInstance-281246124 tempest-TestShelveInstance-281246124-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-981622055" status: 202 len: 0 microversion: 2.1 time: 0.033412 Jul 20 08:37:28.192958 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 655/1262] 10.222.0.64 () {58 vars in 1250 bytes} [Wed Jul 20 08:37:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-981622055 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:37:28.707388 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-a0ee7879-d333-4bd8-b64c-82a439ff63ea req-ffd627bd-68c4-492b-8438-ff2cf46deaa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9589ff-3f5c-4537-9fde-1b5e676b7e09", "name": "network-vif-plugged", "status": "completed", "tag": "08b8e9ae-c7b3-47d7-8038-a5fdfb1440e4"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:37:28.720619 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-a0ee7879-d333-4bd8-b64c-82a439ff63ea req-ffd627bd-68c4-492b-8438-ff2cf46deaa6 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:28.721446 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-a0ee7879-d333-4bd8-b64c-82a439ff63ea req-ffd627bd-68c4-492b-8438-ff2cf46deaa6 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:28.748026 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-a0ee7879-d333-4bd8-b64c-82a439ff63ea req-ffd627bd-68c4-492b-8438-ff2cf46deaa6 service nova] Creating event network-vif-plugged:08b8e9ae-c7b3-47d7-8038-a5fdfb1440e4 for instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 on hv-cinder-82308 Jul 20 08:37:28.753516 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-a0ee7879-d333-4bd8-b64c-82a439ff63ea req-ffd627bd-68c4-492b-8438-ff2cf46deaa6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049940 Jul 20 08:37:28.754265 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 608/1263] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:37:28.902572 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-57a992cb-5050-4a9b-9495-369178700080 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:28.903901 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-57a992cb-5050-4a9b-9495-369178700080 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:28.911015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-57a992cb-5050-4a9b-9495-369178700080 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:28.911879 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-57a992cb-5050-4a9b-9495-369178700080 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:28.913084 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-57a992cb-5050-4a9b-9495-369178700080 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:28.914610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-57a992cb-5050-4a9b-9495-369178700080 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:29.080488 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-95655fc9-121a-4a51-9998-7aa54a129db9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:29.081309 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-95655fc9-121a-4a51-9998-7aa54a129db9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:29.089961 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-95655fc9-121a-4a51-9998-7aa54a129db9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:29.090405 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-95655fc9-121a-4a51-9998-7aa54a129db9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:29.091419 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-95655fc9-121a-4a51-9998-7aa54a129db9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:29.092045 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-95655fc9-121a-4a51-9998-7aa54a129db9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:29.220350 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-57a992cb-5050-4a9b-9495-369178700080 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:29.231302 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-57a992cb-5050-4a9b-9495-369178700080 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1278 microversion: 2.1 time: 0.333686 Jul 20 08:37:29.233511 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 656/1264] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:28 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1278 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:29.239217 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-0432029e-804c-4a2a-bdee-dbaf2d2bc34b req-25e46dc5-dc70-40e0-9f41-c8acadef08d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbb9c5a6-428c-4725-ad79-45132db1c198", "tag": "50598d79-6502-43f4-85f4-da18b9881657"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:37:29.249386 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-0432029e-804c-4a2a-bdee-dbaf2d2bc34b req-25e46dc5-dc70-40e0-9f41-c8acadef08d1 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:29.250167 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-0432029e-804c-4a2a-bdee-dbaf2d2bc34b req-25e46dc5-dc70-40e0-9f41-c8acadef08d1 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:29.264706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-0432029e-804c-4a2a-bdee-dbaf2d2bc34b req-25e46dc5-dc70-40e0-9f41-c8acadef08d1 service nova] Creating event network-changed:50598d79-6502-43f4-85f4-da18b9881657 for instance fbb9c5a6-428c-4725-ad79-45132db1c198 on hv-cinder-82308 Jul 20 08:37:29.270874 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-0432029e-804c-4a2a-bdee-dbaf2d2bc34b req-25e46dc5-dc70-40e0-9f41-c8acadef08d1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035785 Jul 20 08:37:29.271929 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 657/1265] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:37:29.470034 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-95655fc9-121a-4a51-9998-7aa54a129db9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:29.479256 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-95655fc9-121a-4a51-9998-7aa54a129db9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:29.480824 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-95655fc9-121a-4a51-9998-7aa54a129db9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:29.482040 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-95655fc9-121a-4a51-9998-7aa54a129db9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1732 microversion: 2.20 time: 0.405972 Jul 20 08:37:29.482644 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 609/1266] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:29 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1732 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:37:30.250815 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-074bc32b-7c91-4539-8a1c-90d57b32bda2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:30.251506 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-074bc32b-7c91-4539-8a1c-90d57b32bda2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:30.257687 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-074bc32b-7c91-4539-8a1c-90d57b32bda2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:30.258134 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-074bc32b-7c91-4539-8a1c-90d57b32bda2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:30.258936 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-074bc32b-7c91-4539-8a1c-90d57b32bda2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:30.259367 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-074bc32b-7c91-4539-8a1c-90d57b32bda2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:30.420038 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-074bc32b-7c91-4539-8a1c-90d57b32bda2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:30.429031 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-074bc32b-7c91-4539-8a1c-90d57b32bda2 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1278 microversion: 2.1 time: 0.183012 Jul 20 08:37:30.429624 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 658/1267] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:30 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1278 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:30.501507 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-039d3a9e-9e91-482a-b95b-5ce35b555af3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:30.503384 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-039d3a9e-9e91-482a-b95b-5ce35b555af3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:30.513783 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-039d3a9e-9e91-482a-b95b-5ce35b555af3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:30.514890 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-039d3a9e-9e91-482a-b95b-5ce35b555af3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:30.515522 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-039d3a9e-9e91-482a-b95b-5ce35b555af3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:30.515960 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-039d3a9e-9e91-482a-b95b-5ce35b555af3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:31.104339 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-039d3a9e-9e91-482a-b95b-5ce35b555af3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:31.112984 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-039d3a9e-9e91-482a-b95b-5ce35b555af3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:31.114505 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-039d3a9e-9e91-482a-b95b-5ce35b555af3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:31.118549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-039d3a9e-9e91-482a-b95b-5ce35b555af3 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1732 microversion: 2.20 time: 0.618347 Jul 20 08:37:31.129494 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 610/1268] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:30 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1732 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:37:31.448938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b7278f2c-298a-4637-9ac6-d79b295ef5bc tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:31.449608 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b7278f2c-298a-4637-9ac6-d79b295ef5bc tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:31.458414 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b7278f2c-298a-4637-9ac6-d79b295ef5bc tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:31.459323 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b7278f2c-298a-4637-9ac6-d79b295ef5bc tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:31.460183 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b7278f2c-298a-4637-9ac6-d79b295ef5bc tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:31.460564 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b7278f2c-298a-4637-9ac6-d79b295ef5bc tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:31.734181 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b7278f2c-298a-4637-9ac6-d79b295ef5bc tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:31.775711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b7278f2c-298a-4637-9ac6-d79b295ef5bc tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1278 microversion: 2.1 time: 0.330381 Jul 20 08:37:31.779088 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 659/1269] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:31 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1278 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:32.139663 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-42574461-bc44-476f-a68d-4818c3814340 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:32.141376 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-42574461-bc44-476f-a68d-4818c3814340 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:32.149297 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-42574461-bc44-476f-a68d-4818c3814340 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:32.149297 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-42574461-bc44-476f-a68d-4818c3814340 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:32.149297 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-42574461-bc44-476f-a68d-4818c3814340 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:32.149862 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-42574461-bc44-476f-a68d-4818c3814340 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:32.425874 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-42574461-bc44-476f-a68d-4818c3814340 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:32.442005 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-42574461-bc44-476f-a68d-4818c3814340 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:32.445089 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-42574461-bc44-476f-a68d-4818c3814340 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:32.446636 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-42574461-bc44-476f-a68d-4818c3814340 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1719 microversion: 2.20 time: 0.312455 Jul 20 08:37:32.448310 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 611/1270] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:37:32 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1719 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:37:32.793695 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-c6b04789-db60-4dec-8622-c3a95ff8422b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:32.794569 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-c6b04789-db60-4dec-8622-c3a95ff8422b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:32.803314 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c6b04789-db60-4dec-8622-c3a95ff8422b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:32.804078 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c6b04789-db60-4dec-8622-c3a95ff8422b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:32.805121 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c6b04789-db60-4dec-8622-c3a95ff8422b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:32.805348 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-c6b04789-db60-4dec-8622-c3a95ff8422b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:32.985139 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-c6b04789-db60-4dec-8622-c3a95ff8422b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:33.000038 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-c6b04789-db60-4dec-8622-c3a95ff8422b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1278 microversion: 2.1 time: 0.209797 Jul 20 08:37:33.001561 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 660/1271] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:32 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1278 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:34.020200 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8bcd4f90-fcec-4a2e-98a1-cc1572b9d8c4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:34.022207 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8bcd4f90-fcec-4a2e-98a1-cc1572b9d8c4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:34.032610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8bcd4f90-fcec-4a2e-98a1-cc1572b9d8c4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:34.033585 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8bcd4f90-fcec-4a2e-98a1-cc1572b9d8c4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:34.034917 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8bcd4f90-fcec-4a2e-98a1-cc1572b9d8c4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:34.035805 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8bcd4f90-fcec-4a2e-98a1-cc1572b9d8c4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:34.312557 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8bcd4f90-fcec-4a2e-98a1-cc1572b9d8c4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:34.325695 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8bcd4f90-fcec-4a2e-98a1-cc1572b9d8c4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1278 microversion: 2.1 time: 0.310483 Jul 20 08:37:34.326679 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 612/1272] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:34 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1278 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:35.279805 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5c8c48a0-9471-42c6-81ac-0d538121aa60 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:35.281141 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-5c8c48a0-9471-42c6-81ac-0d538121aa60 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:35.289279 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5c8c48a0-9471-42c6-81ac-0d538121aa60 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:35.289715 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5c8c48a0-9471-42c6-81ac-0d538121aa60 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:35.290562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5c8c48a0-9471-42c6-81ac-0d538121aa60 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:35.291096 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5c8c48a0-9471-42c6-81ac-0d538121aa60 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:35.329516 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-5c8c48a0-9471-42c6-81ac-0d538121aa60 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054199 Jul 20 08:37:35.330047 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 661/1273] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Jul 20 08:37:35 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:37:35.342023 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d0d2e4d2-5e66-4673-bf0d-0bf95c26ef61 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:35.342608 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d0d2e4d2-5e66-4673-bf0d-0bf95c26ef61 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:35.343093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-1db78768-c04f-4fb7-aa2f-9cd87aa28d6d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:35.344909 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-1db78768-c04f-4fb7-aa2f-9cd87aa28d6d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:35.350372 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d0d2e4d2-5e66-4673-bf0d-0bf95c26ef61 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:35.350845 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d0d2e4d2-5e66-4673-bf0d-0bf95c26ef61 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:35.351654 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d0d2e4d2-5e66-4673-bf0d-0bf95c26ef61 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:35.352271 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d0d2e4d2-5e66-4673-bf0d-0bf95c26ef61 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:35.354711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1db78768-c04f-4fb7-aa2f-9cd87aa28d6d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:35.355173 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1db78768-c04f-4fb7-aa2f-9cd87aa28d6d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:35.357496 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1db78768-c04f-4fb7-aa2f-9cd87aa28d6d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:35.357496 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-1db78768-c04f-4fb7-aa2f-9cd87aa28d6d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:35.384421 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d0d2e4d2-5e66-4673-bf0d-0bf95c26ef61 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments/61e9981c-236c-424e-ac19-a12fa414ae93" status: 200 len: 194 microversion: 2.1 time: 0.046772 Jul 20 08:37:35.385039 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 613/1274] 10.222.0.64 () {58 vars in 1412 bytes} [Wed Jul 20 08:37:35 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments/61e9981c-236c-424e-ac19-a12fa414ae93 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:37:35.577917 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-1db78768-c04f-4fb7-aa2f-9cd87aa28d6d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:35.590544 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-1db78768-c04f-4fb7-aa2f-9cd87aa28d6d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1266 microversion: 2.1 time: 0.251941 Jul 20 08:37:35.591771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 662/1275] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:35 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:36.609202 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5850f645-db76-4012-aa40-6a6dbf22e3ce tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:36.609948 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5850f645-db76-4012-aa40-6a6dbf22e3ce tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:36.619420 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5850f645-db76-4012-aa40-6a6dbf22e3ce tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:36.620263 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5850f645-db76-4012-aa40-6a6dbf22e3ce tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:36.621373 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5850f645-db76-4012-aa40-6a6dbf22e3ce tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:36.621994 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5850f645-db76-4012-aa40-6a6dbf22e3ce tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:36.839849 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5850f645-db76-4012-aa40-6a6dbf22e3ce tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:36.852448 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-d03e1675-505d-41f5-843c-9b9a8f46b2a8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d71fce71-089f-47b8-9838-5110770dcbde"}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:37:36.853460 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5850f645-db76-4012-aa40-6a6dbf22e3ce tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1266 microversion: 2.1 time: 0.248584 Jul 20 08:37:36.853775 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-d03e1675-505d-41f5-843c-9b9a8f46b2a8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:36.854179 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 614/1276] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:36 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:36.866174 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d03e1675-505d-41f5-843c-9b9a8f46b2a8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:36.866635 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d03e1675-505d-41f5-843c-9b9a8f46b2a8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:36.867429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d03e1675-505d-41f5-843c-9b9a8f46b2a8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:36.867854 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-d03e1675-505d-41f5-843c-9b9a8f46b2a8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:37.142116 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-d03e1675-505d-41f5-843c-9b9a8f46b2a8 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "POST /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294392 Jul 20 08:37:37.142785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 663/1277] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Jul 20 08:37:36 2022] POST /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:37:37.873010 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9044a749-0348-49f7-bd9e-daf60e2cd14b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:37.875155 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9044a749-0348-49f7-bd9e-daf60e2cd14b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:37.884557 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9044a749-0348-49f7-bd9e-daf60e2cd14b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:37.885157 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9044a749-0348-49f7-bd9e-daf60e2cd14b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:37.885948 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9044a749-0348-49f7-bd9e-daf60e2cd14b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:37.886569 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9044a749-0348-49f7-bd9e-daf60e2cd14b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:38.037361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-9044a749-0348-49f7-bd9e-daf60e2cd14b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:38.045318 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9044a749-0348-49f7-bd9e-daf60e2cd14b tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1266 microversion: 2.1 time: 0.177030 Jul 20 08:37:38.045893 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 615/1278] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:37 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:39.064073 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ffeb6805-62e1-4e7d-ae48-0373eb32a922 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:39.064768 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ffeb6805-62e1-4e7d-ae48-0373eb32a922 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:39.071968 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ffeb6805-62e1-4e7d-ae48-0373eb32a922 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:39.072416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ffeb6805-62e1-4e7d-ae48-0373eb32a922 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:39.073223 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ffeb6805-62e1-4e7d-ae48-0373eb32a922 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:39.073707 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ffeb6805-62e1-4e7d-ae48-0373eb32a922 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:39.215656 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-ffeb6805-62e1-4e7d-ae48-0373eb32a922 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:39.223590 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ffeb6805-62e1-4e7d-ae48-0373eb32a922 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1266 microversion: 2.1 time: 0.164330 Jul 20 08:37:39.224458 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 664/1279] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:39 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:40.242200 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-0b4bdf47-94a0-4931-bb4c-e52d8d9a5790 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:40.242967 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-0b4bdf47-94a0-4931-bb4c-e52d8d9a5790 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:40.249843 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0b4bdf47-94a0-4931-bb4c-e52d8d9a5790 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:40.250301 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0b4bdf47-94a0-4931-bb4c-e52d8d9a5790 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:40.251135 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0b4bdf47-94a0-4931-bb4c-e52d8d9a5790 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:40.251572 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0b4bdf47-94a0-4931-bb4c-e52d8d9a5790 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:40.422376 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0b4bdf47-94a0-4931-bb4c-e52d8d9a5790 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:40.435068 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-0b4bdf47-94a0-4931-bb4c-e52d8d9a5790 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1266 microversion: 2.1 time: 0.196663 Jul 20 08:37:40.435811 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 616/1280] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:40 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:41.453366 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-bb0f1a9e-442b-435b-ac8c-041d3a930ed4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:41.454101 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-bb0f1a9e-442b-435b-ac8c-041d3a930ed4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:41.461307 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bb0f1a9e-442b-435b-ac8c-041d3a930ed4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:41.461759 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bb0f1a9e-442b-435b-ac8c-041d3a930ed4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:41.462549 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bb0f1a9e-442b-435b-ac8c-041d3a930ed4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:41.463015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bb0f1a9e-442b-435b-ac8c-041d3a930ed4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:41.615530 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-bb0f1a9e-442b-435b-ac8c-041d3a930ed4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:41.623491 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-bb0f1a9e-442b-435b-ac8c-041d3a930ed4 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1266 microversion: 2.1 time: 0.173874 Jul 20 08:37:41.624074 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 665/1281] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:41 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:42.641712 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-1dd6ca4d-99ff-45e7-a04a-07ef860e4b38 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:42.642355 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-1dd6ca4d-99ff-45e7-a04a-07ef860e4b38 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:42.650401 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1dd6ca4d-99ff-45e7-a04a-07ef860e4b38 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:42.650862 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1dd6ca4d-99ff-45e7-a04a-07ef860e4b38 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:42.651790 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1dd6ca4d-99ff-45e7-a04a-07ef860e4b38 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:42.652365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1dd6ca4d-99ff-45e7-a04a-07ef860e4b38 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:42.814983 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1dd6ca4d-99ff-45e7-a04a-07ef860e4b38 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:42.824422 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-1dd6ca4d-99ff-45e7-a04a-07ef860e4b38 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1266 microversion: 2.1 time: 0.186895 Jul 20 08:37:42.825270 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 617/1282] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:42 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:37:43.842534 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-aeb03649-ed2a-49f9-a94e-1c4ae345ce0d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:43.843197 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-aeb03649-ed2a-49f9-a94e-1c4ae345ce0d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:43.850361 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aeb03649-ed2a-49f9-a94e-1c4ae345ce0d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:43.850854 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aeb03649-ed2a-49f9-a94e-1c4ae345ce0d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:43.851639 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aeb03649-ed2a-49f9-a94e-1c4ae345ce0d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:43.852082 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-aeb03649-ed2a-49f9-a94e-1c4ae345ce0d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:43.872925 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:37:44.020031 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-aeb03649-ed2a-49f9-a94e-1c4ae345ce0d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:44.034053 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-aeb03649-ed2a-49f9-a94e-1c4ae345ce0d tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1266 microversion: 2.1 time: 0.194937 Jul 20 08:37:44.035213 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 666/1283] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:43 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:37:45.062648 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-cf7c2554-248b-48bc-83ef-c4486c16798f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:45.063675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-cf7c2554-248b-48bc-83ef-c4486c16798f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:45.075384 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cf7c2554-248b-48bc-83ef-c4486c16798f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:45.076192 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cf7c2554-248b-48bc-83ef-c4486c16798f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:45.077579 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cf7c2554-248b-48bc-83ef-c4486c16798f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:45.078371 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cf7c2554-248b-48bc-83ef-c4486c16798f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:45.229340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-cf7c2554-248b-48bc-83ef-c4486c16798f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:45.242553 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-cf7c2554-248b-48bc-83ef-c4486c16798f tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1266 microversion: 2.1 time: 0.186536 Jul 20 08:37:45.243625 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 618/1284] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:45 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:37:45.792018 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-fd10a9dc-d140-4229-96b5-afa78c22c8f5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:45.793033 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-fd10a9dc-d140-4229-96b5-afa78c22c8f5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:45.799938 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fd10a9dc-d140-4229-96b5-afa78c22c8f5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:45.800461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fd10a9dc-d140-4229-96b5-afa78c22c8f5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:45.801260 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fd10a9dc-d140-4229-96b5-afa78c22c8f5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:45.801858 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-fd10a9dc-d140-4229-96b5-afa78c22c8f5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:45.837884 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-fd10a9dc-d140-4229-96b5-afa78c22c8f5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050441 Jul 20 08:37:45.838510 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 667/1285] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Jul 20 08:37:45 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:37:45.980365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ad7c2629-da5c-458f-a4ba-aba9b116d350 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:45.980853 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ad7c2629-da5c-458f-a4ba-aba9b116d350 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:45.987327 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ad7c2629-da5c-458f-a4ba-aba9b116d350 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:45.987776 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ad7c2629-da5c-458f-a4ba-aba9b116d350 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:45.988576 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ad7c2629-da5c-458f-a4ba-aba9b116d350 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:45.989013 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ad7c2629-da5c-458f-a4ba-aba9b116d350 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:46.022435 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ad7c2629-da5c-458f-a4ba-aba9b116d350 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments/61e9981c-236c-424e-ac19-a12fa414ae93" status: 200 len: 194 microversion: 2.1 time: 0.045946 Jul 20 08:37:46.025152 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 619/1286] 10.222.0.64 () {58 vars in 1412 bytes} [Wed Jul 20 08:37:45 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments/61e9981c-236c-424e-ac19-a12fa414ae93 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:37:46.033034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-08e3244c-77f6-40d9-b1c6-55428b6b11e4 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:46.033582 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-08e3244c-77f6-40d9-b1c6-55428b6b11e4 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:46.040758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-08e3244c-77f6-40d9-b1c6-55428b6b11e4 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:46.041202 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-08e3244c-77f6-40d9-b1c6-55428b6b11e4 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:46.042012 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-08e3244c-77f6-40d9-b1c6-55428b6b11e4 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:46.042436 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-08e3244c-77f6-40d9-b1c6-55428b6b11e4 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:46.136862 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.objects.instance [None req-08e3244c-77f6-40d9-b1c6-55428b6b11e4 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lazy-loading 'services' on Instance uuid 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 {{(pid=117828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:37:46.219720 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-08e3244c-77f6-40d9-b1c6-55428b6b11e4 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments/61e9981c-236c-424e-ac19-a12fa414ae93" status: 202 len: 0 microversion: 2.1 time: 0.190246 Jul 20 08:37:46.220245 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 668/1287] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Jul 20 08:37:46 2022] DELETE /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments/61e9981c-236c-424e-ac19-a12fa414ae93 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 08:37:46.261075 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-54384d34-77fd-4216-8b87-dfb41634d962 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:46.262598 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-54384d34-77fd-4216-8b87-dfb41634d962 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:46.270081 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-54384d34-77fd-4216-8b87-dfb41634d962 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:46.271395 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-54384d34-77fd-4216-8b87-dfb41634d962 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:46.272403 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-54384d34-77fd-4216-8b87-dfb41634d962 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:46.273050 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-54384d34-77fd-4216-8b87-dfb41634d962 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:46.293875 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:37:46.432005 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-54384d34-77fd-4216-8b87-dfb41634d962 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:46.440890 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-54384d34-77fd-4216-8b87-dfb41634d962 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1266 microversion: 2.1 time: 0.183577 Jul 20 08:37:46.441664 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 620/1288] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:46 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:37:46.799219 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-baa3399e-d177-4eae-aa97-b53646e50405 req-44754439-4a9f-4a4a-9913-2e2c6ce76857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbb9c5a6-428c-4725-ad79-45132db1c198", "name": "network-vif-plugged", "status": "completed", "tag": "50598d79-6502-43f4-85f4-da18b9881657"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:37:46.810270 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-baa3399e-d177-4eae-aa97-b53646e50405 req-44754439-4a9f-4a4a-9913-2e2c6ce76857 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:46.811653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-baa3399e-d177-4eae-aa97-b53646e50405 req-44754439-4a9f-4a4a-9913-2e2c6ce76857 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:46.824539 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-baa3399e-d177-4eae-aa97-b53646e50405 req-44754439-4a9f-4a4a-9913-2e2c6ce76857 service nova] Creating event network-vif-plugged:50598d79-6502-43f4-85f4-da18b9881657 for instance fbb9c5a6-428c-4725-ad79-45132db1c198 on hv-cinder-82308 Jul 20 08:37:46.829455 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-baa3399e-d177-4eae-aa97-b53646e50405 req-44754439-4a9f-4a4a-9913-2e2c6ce76857 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034440 Jul 20 08:37:46.830056 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 669/1289] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:37:47.460028 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-64f279d8-28a1-47c7-b02b-d38990ba9af0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:47.460644 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-64f279d8-28a1-47c7-b02b-d38990ba9af0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:47.467370 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-64f279d8-28a1-47c7-b02b-d38990ba9af0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:47.467818 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-64f279d8-28a1-47c7-b02b-d38990ba9af0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:47.468597 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-64f279d8-28a1-47c7-b02b-d38990ba9af0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:47.469028 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-64f279d8-28a1-47c7-b02b-d38990ba9af0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:47.612284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-64f279d8-28a1-47c7-b02b-d38990ba9af0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:47.619922 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-64f279d8-28a1-47c7-b02b-d38990ba9af0 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1266 microversion: 2.1 time: 0.163984 Jul 20 08:37:47.620489 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 621/1290] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:47 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:48.420566 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-eaa66929-ff3c-4a0a-9f9b-f3b4f26b61e3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:48.421185 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-eaa66929-ff3c-4a0a-9f9b-f3b4f26b61e3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:48.428631 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eaa66929-ff3c-4a0a-9f9b-f3b4f26b61e3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:48.429078 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eaa66929-ff3c-4a0a-9f9b-f3b4f26b61e3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:48.429854 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eaa66929-ff3c-4a0a-9f9b-f3b4f26b61e3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:48.430293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-eaa66929-ff3c-4a0a-9f9b-f3b4f26b61e3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:48.461015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-eaa66929-ff3c-4a0a-9f9b-f3b4f26b61e3 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments/d71fce71-089f-47b8-9838-5110770dcbde" status: 200 len: 194 microversion: 2.1 time: 0.044746 Jul 20 08:37:48.461628 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 670/1291] 10.222.0.64 () {58 vars in 1412 bytes} [Wed Jul 20 08:37:48 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments/d71fce71-089f-47b8-9838-5110770dcbde => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:37:48.471596 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-48d7ad6b-0895-4fbf-98ce-561401100729 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:48.472127 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-48d7ad6b-0895-4fbf-98ce-561401100729 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:48.478946 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-48d7ad6b-0895-4fbf-98ce-561401100729 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:48.479399 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-48d7ad6b-0895-4fbf-98ce-561401100729 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:48.480167 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-48d7ad6b-0895-4fbf-98ce-561401100729 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:48.480603 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-48d7ad6b-0895-4fbf-98ce-561401100729 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:48.571295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.objects.instance [None req-48d7ad6b-0895-4fbf-98ce-561401100729 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lazy-loading 'services' on Instance uuid 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 {{(pid=117829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:37:48.637374 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-258fa81a-7a76-40cd-beb4-8f938710e733 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:48.638326 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-258fa81a-7a76-40cd-beb4-8f938710e733 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:48.640973 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:37:48.647493 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-48d7ad6b-0895-4fbf-98ce-561401100729 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments/d71fce71-089f-47b8-9838-5110770dcbde" status: 202 len: 0 microversion: 2.1 time: 0.179665 Jul 20 08:37:48.647995 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-258fa81a-7a76-40cd-beb4-8f938710e733 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:48.648458 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-258fa81a-7a76-40cd-beb4-8f938710e733 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:48.649326 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-258fa81a-7a76-40cd-beb4-8f938710e733 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:48.649772 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-258fa81a-7a76-40cd-beb4-8f938710e733 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:48.651407 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 622/1292] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Jul 20 08:37:48 2022] DELETE /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments/d71fce71-089f-47b8-9838-5110770dcbde => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 08:37:48.804298 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-258fa81a-7a76-40cd-beb4-8f938710e733 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:48.811945 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-258fa81a-7a76-40cd-beb4-8f938710e733 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1266 microversion: 2.1 time: 0.178673 Jul 20 08:37:48.812523 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 671/1293] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:48 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:49.830272 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f452b6fa-1bf6-4b33-8269-9014903f5caa tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:49.831065 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f452b6fa-1bf6-4b33-8269-9014903f5caa tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:49.838262 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f452b6fa-1bf6-4b33-8269-9014903f5caa tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:49.838741 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f452b6fa-1bf6-4b33-8269-9014903f5caa tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:49.839646 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f452b6fa-1bf6-4b33-8269-9014903f5caa tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:49.840091 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f452b6fa-1bf6-4b33-8269-9014903f5caa tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:49.996878 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f452b6fa-1bf6-4b33-8269-9014903f5caa tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:50.005575 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f452b6fa-1bf6-4b33-8269-9014903f5caa tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1453 microversion: 2.1 time: 0.179253 Jul 20 08:37:50.006295 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 623/1294] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:49 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:50.021682 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-61aae55d-feb1-4100-9990-e94709f81dbf tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:50.022287 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-61aae55d-feb1-4100-9990-e94709f81dbf tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:50.030203 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-61aae55d-feb1-4100-9990-e94709f81dbf tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:50.030681 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-61aae55d-feb1-4100-9990-e94709f81dbf tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:50.031457 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-61aae55d-feb1-4100-9990-e94709f81dbf tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:50.032076 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-61aae55d-feb1-4100-9990-e94709f81dbf tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:50.191399 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-61aae55d-feb1-4100-9990-e94709f81dbf tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:50.200450 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-61aae55d-feb1-4100-9990-e94709f81dbf tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1453 microversion: 2.1 time: 0.182487 Jul 20 08:37:50.201047 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 672/1295] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:50 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1453 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:50.904199 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-62bcb398-c1a8-490d-a7d8-b21e0ced3f42 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:50.905208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-62bcb398-c1a8-490d-a7d8-b21e0ced3f42 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:50.912648 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-62bcb398-c1a8-490d-a7d8-b21e0ced3f42 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:50.913108 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-62bcb398-c1a8-490d-a7d8-b21e0ced3f42 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:50.913915 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-62bcb398-c1a8-490d-a7d8-b21e0ced3f42 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:50.914362 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-62bcb398-c1a8-490d-a7d8-b21e0ced3f42 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:50.947975 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-62bcb398-c1a8-490d-a7d8-b21e0ced3f42 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047704 Jul 20 08:37:50.948685 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 624/1296] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Jul 20 08:37:50 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 08:37:51.121940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a216e35d-16d8-476f-9bce-bd8eb7da5423 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:51.123843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a216e35d-16d8-476f-9bce-bd8eb7da5423 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:51.136356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a216e35d-16d8-476f-9bce-bd8eb7da5423 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:51.137180 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a216e35d-16d8-476f-9bce-bd8eb7da5423 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:51.138781 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a216e35d-16d8-476f-9bce-bd8eb7da5423 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:51.139848 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a216e35d-16d8-476f-9bce-bd8eb7da5423 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:51.176943 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a216e35d-16d8-476f-9bce-bd8eb7da5423 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062231 Jul 20 08:37:51.177552 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 673/1297] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Jul 20 08:37:51 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 08:37:51.255256 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-67e7dd9d-fcb2-424e-a887-75597cfe02cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:51.255899 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-67e7dd9d-fcb2-424e-a887-75597cfe02cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:51.263175 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-67e7dd9d-fcb2-424e-a887-75597cfe02cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:51.263720 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-67e7dd9d-fcb2-424e-a887-75597cfe02cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:51.264861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-67e7dd9d-fcb2-424e-a887-75597cfe02cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:51.265417 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-67e7dd9d-fcb2-424e-a887-75597cfe02cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:51.293515 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-67e7dd9d-fcb2-424e-a887-75597cfe02cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Going to try to terminate instance {{(pid=117829) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:37:51.378811 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-67e7dd9d-fcb2-424e-a887-75597cfe02cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70" status: 204 len: 0 microversion: 2.1 time: 0.127841 Jul 20 08:37:51.383617 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 625/1298] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:37:51 2022] DELETE /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:37:51.391960 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-545b32ae-c49e-44a8-af85-6e6ee5ad376e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:51.392988 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-545b32ae-c49e-44a8-af85-6e6ee5ad376e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:51.402769 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-545b32ae-c49e-44a8-af85-6e6ee5ad376e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:51.403620 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-545b32ae-c49e-44a8-af85-6e6ee5ad376e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:51.405059 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-545b32ae-c49e-44a8-af85-6e6ee5ad376e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:51.405686 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-545b32ae-c49e-44a8-af85-6e6ee5ad376e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:51.905147 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-545b32ae-c49e-44a8-af85-6e6ee5ad376e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:51.914227 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-545b32ae-c49e-44a8-af85-6e6ee5ad376e tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70" status: 200 len: 1673 microversion: 2.1 time: 0.528871 Jul 20 08:37:51.914957 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 674/1299] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:51 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 => generated 1673 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:52.791651 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-e9b5d3bc-257b-4639-a4be-de73f78c5197 req-95d5705a-12d2-46ab-9bcb-b5fd9f173aaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbb9c5a6-428c-4725-ad79-45132db1c198", "tag": "50598d79-6502-43f4-85f4-da18b9881657"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:37:52.803121 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-e9b5d3bc-257b-4639-a4be-de73f78c5197 req-95d5705a-12d2-46ab-9bcb-b5fd9f173aaf service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:52.803566 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-e9b5d3bc-257b-4639-a4be-de73f78c5197 req-95d5705a-12d2-46ab-9bcb-b5fd9f173aaf service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:52.816562 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-e9b5d3bc-257b-4639-a4be-de73f78c5197 req-95d5705a-12d2-46ab-9bcb-b5fd9f173aaf service nova] Creating event network-changed:50598d79-6502-43f4-85f4-da18b9881657 for instance fbb9c5a6-428c-4725-ad79-45132db1c198 on hv-cinder-82308 Jul 20 08:37:52.822782 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-e9b5d3bc-257b-4639-a4be-de73f78c5197 req-95d5705a-12d2-46ab-9bcb-b5fd9f173aaf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036250 Jul 20 08:37:52.823542 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 626/1300] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:37:52.937773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-76a9a85b-b8a9-406b-835f-d19379295e9b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:52.941521 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-76a9a85b-b8a9-406b-835f-d19379295e9b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:52.949404 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-76a9a85b-b8a9-406b-835f-d19379295e9b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:52.949848 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-76a9a85b-b8a9-406b-835f-d19379295e9b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:52.950660 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-76a9a85b-b8a9-406b-835f-d19379295e9b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:52.951095 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-76a9a85b-b8a9-406b-835f-d19379295e9b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:53.125309 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-76a9a85b-b8a9-406b-835f-d19379295e9b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:53.133629 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-76a9a85b-b8a9-406b-835f-d19379295e9b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70" status: 200 len: 1673 microversion: 2.1 time: 0.204549 Jul 20 08:37:53.134377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 675/1301] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:52 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 => generated 1673 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:54.154065 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8fcc474c-7f29-4bfc-a354-10e8f2feee09 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:54.155035 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8fcc474c-7f29-4bfc-a354-10e8f2feee09 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:54.162684 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8fcc474c-7f29-4bfc-a354-10e8f2feee09 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:54.163219 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8fcc474c-7f29-4bfc-a354-10e8f2feee09 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:54.164070 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8fcc474c-7f29-4bfc-a354-10e8f2feee09 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:54.164502 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8fcc474c-7f29-4bfc-a354-10e8f2feee09 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:54.454172 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8fcc474c-7f29-4bfc-a354-10e8f2feee09 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:54.462564 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8fcc474c-7f29-4bfc-a354-10e8f2feee09 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70" status: 200 len: 1673 microversion: 2.1 time: 0.313199 Jul 20 08:37:54.463195 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 627/1302] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:54 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 => generated 1673 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:37:55.162167 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-c96bdc33-9c7f-4ae1-a566-b3aff247d03d req-18999d7f-8142-4a24-9ebd-c4d1c7346def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a397563-630d-4bdc-b9e3-5c4b6c5f3d70", "name": "network-vif-deleted", "tag": "4ed2e645-2dd2-48a1-af71-1696a608bc20"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:37:55.180190 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-c96bdc33-9c7f-4ae1-a566-b3aff247d03d req-18999d7f-8142-4a24-9ebd-c4d1c7346def service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:55.180942 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-c96bdc33-9c7f-4ae1-a566-b3aff247d03d req-18999d7f-8142-4a24-9ebd-c4d1c7346def service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:55.195584 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-c96bdc33-9c7f-4ae1-a566-b3aff247d03d req-18999d7f-8142-4a24-9ebd-c4d1c7346def service nova] Creating event network-vif-deleted:4ed2e645-2dd2-48a1-af71-1696a608bc20 for instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 on hv-cinder-82308 Jul 20 08:37:55.201829 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-c96bdc33-9c7f-4ae1-a566-b3aff247d03d req-18999d7f-8142-4a24-9ebd-c4d1c7346def service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044612 Jul 20 08:37:55.202800 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 676/1303] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:37:55.480293 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-1a500ba3-058c-4a50-b9b0-4689db975d0b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:55.480850 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-1a500ba3-058c-4a50-b9b0-4689db975d0b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:55.483416 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:37:55.489860 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1a500ba3-058c-4a50-b9b0-4689db975d0b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:55.490387 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1a500ba3-058c-4a50-b9b0-4689db975d0b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:55.491300 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1a500ba3-058c-4a50-b9b0-4689db975d0b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:55.491739 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1a500ba3-058c-4a50-b9b0-4689db975d0b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:55.546163 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1a500ba3-058c-4a50-b9b0-4689db975d0b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:55.546641 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1a500ba3-058c-4a50-b9b0-4689db975d0b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:55.547104 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.objects.instance [None req-1a500ba3-058c-4a50-b9b0-4689db975d0b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lazy-loading 'fault' on Instance uuid 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 {{(pid=117829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:37:55.600202 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1a500ba3-058c-4a50-b9b0-4689db975d0b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2326ff15f294e15806d8a564770b35e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa4764ea3c4f4bf98ea56ee0798adfdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:37:55.612526 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-1a500ba3-058c-4a50-b9b0-4689db975d0b tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70" status: 200 len: 1326 microversion: 2.1 time: 0.135931 Jul 20 08:37:55.613276 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 628/1304] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:55 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 => generated 1326 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:37:56.640030 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5f039d13-b8f3-434f-9d24-e919c83682cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:56.640728 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-5f039d13-b8f3-434f-9d24-e919c83682cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:56.648530 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5f039d13-b8f3-434f-9d24-e919c83682cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:56.648963 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5f039d13-b8f3-434f-9d24-e919c83682cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:56.649739 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5f039d13-b8f3-434f-9d24-e919c83682cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:56.650166 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5f039d13-b8f3-434f-9d24-e919c83682cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:56.667455 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-5f039d13-b8f3-434f-9d24-e919c83682cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] HTTP exception thrown: Instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 could not be found. Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5f039d13-b8f3-434f-9d24-e919c83682cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Request method failure captured: Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 HTTP/1.1 Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wo_BrUuwgwkV5wSxfZ0PaEG2smOS_3EaSmbvX4GHgTNQJGFIGXS1ZXUvj4vWqiSJpk8D_ha_FxABCakdU3k6UT4ptF0CTt99RQTgVHLBXvgUDjNWjGe3Q-hDMJHG9ykhPcUSN7CLIpMh7HYSIJjlzKs1-rXREybKGWkkYUQQHIgYM Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: fa4764ea3c4f4bf98ea56ee0798adfdc Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-AttachVolumeTestJSON-1815855654 Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:37:56.669115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:37:56.670780 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fa4764ea3c4f4bf98ea56ee0798adfdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fa4764ea3c4f4bf98ea56ee0798adfdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fa4764ea3c4f4bf98ea56ee0798adfdc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fa4764ea3c4f4bf98ea56ee0798adfdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:37:56.670780 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-AttachVolumeTestJSON-1815855654 Jul 20 08:37:56.670780 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: fa4764ea3c4f4bf98ea56ee0798adfdc Jul 20 08:37:56.670780 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1815855654 Jul 20 08:37:56.670780 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-AttachVolumeTestJSON-1815855654-project Jul 20 08:37:56.670780 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:37:56.670780 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:37:56.670780 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: b2326ff15f294e15806d8a564770b35e Jul 20 08:37:56.670780 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-AttachVolumeTestJSON-1815855654-project Jul 20 08:37:56.670780 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:37:56.670780 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 could not be found. Jul 20 08:37:56.670780 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': '4a397563-630d-4bdc-b9e3-5c4b6c5f3d70'} Jul 20 08:37:56.671771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:37:56.671771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:37:56.671771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:37:56.671771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:37:56.671771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:37:56.671771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:37:56.671771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:37:56.671771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:37:56.671771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:37:56.671771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:37:56.671771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 could not be found. Jul 20 08:37:56.671771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:37:56.671771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:37:56.671771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:37:56.671771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:37:56.671771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:37:56.671771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:37:56.671771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:37:56.671771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:37:56.671771 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:37:56.673754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:37:56.673754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:37:56.673754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:37:56.673754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:37:56.673754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:37:56.673754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:37:56.673754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:37:56.673754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 could not be found. Jul 20 08:37:56.673754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:37:56.673754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:37:56.673754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:37:56.673754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:37:56.673754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:37:56.673754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:37:56.673754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:37:56.673754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:37:56.673754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 could not be found. Jul 20 08:37:56.673754 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:37:56.675226 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5f039d13-b8f3-434f-9d24-e919c83682cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Returning 404 to user: Instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:37:56.675226 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-5f039d13-b8f3-434f-9d24-e919c83682cb tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70" status: 404 len: 111 microversion: 2.1 time: 0.035635 Jul 20 08:37:56.675226 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 677/1305] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:56 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:37:56.681004 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-29d2f7a8-76f1-4ab8-b266-75cbc0ce782a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '.version_select at 0x7fe39a8e7af0>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:56.700726 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-29d2f7a8-76f1-4ab8-b266-75cbc0ce782a tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-643525426" status: 202 len: 0 microversion: 2.1 time: 0.023872 Jul 20 08:37:56.701342 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 629/1306] 10.222.0.64 () {58 vars in 1217 bytes} [Wed Jul 20 08:37:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-643525426 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:37:59.724644 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-22c4b178-e29d-4cad-b467-b5dce62591b5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:59.725254 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-22c4b178-e29d-4cad-b467-b5dce62591b5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:59.732006 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-22c4b178-e29d-4cad-b467-b5dce62591b5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:59.732452 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-22c4b178-e29d-4cad-b467-b5dce62591b5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:59.733241 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-22c4b178-e29d-4cad-b467-b5dce62591b5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:59.733673 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-22c4b178-e29d-4cad-b467-b5dce62591b5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:59.750503 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-22c4b178-e29d-4cad-b467-b5dce62591b5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] HTTP exception thrown: Instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 could not be found. Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-22c4b178-e29d-4cad-b467-b5dce62591b5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Request method failure captured: Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: DELETE /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 HTTP/1.1 Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wo_BrUuwgwkV5wSxfZ0PaEG2smOS_3EaSmbvX4GHgTNQJGFIGXS1ZXUvj4vWqiSJpk8D_ha_FxABCakdU3k6UT4ptF0CTt99RQTgVHLBXvgUDjNWjGe3Q-hDMJHG9ykhPcUSN7CLIpMh7HYSIJjlzKs1-rXREybKGWkkYUQQHIgYM Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: fa4764ea3c4f4bf98ea56ee0798adfdc Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-AttachVolumeTestJSON-1815855654 Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:37:59.752126 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:37:59.753543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fa4764ea3c4f4bf98ea56ee0798adfdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fa4764ea3c4f4bf98ea56ee0798adfdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fa4764ea3c4f4bf98ea56ee0798adfdc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fa4764ea3c4f4bf98ea56ee0798adfdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:37:59.753543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-AttachVolumeTestJSON-1815855654 Jul 20 08:37:59.753543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: fa4764ea3c4f4bf98ea56ee0798adfdc Jul 20 08:37:59.753543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1815855654 Jul 20 08:37:59.753543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-AttachVolumeTestJSON-1815855654-project Jul 20 08:37:59.753543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:37:59.753543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:37:59.753543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: b2326ff15f294e15806d8a564770b35e Jul 20 08:37:59.753543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-AttachVolumeTestJSON-1815855654-project Jul 20 08:37:59.753543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:37:59.753543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 could not be found. Jul 20 08:37:59.753543 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': '4a397563-630d-4bdc-b9e3-5c4b6c5f3d70'} Jul 20 08:37:59.754296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:37:59.754296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:37:59.754296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:37:59.754296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:37:59.754296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:37:59.754296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:37:59.754296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:37:59.754296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:37:59.754296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:37:59.754296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:37:59.754296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 could not be found. Jul 20 08:37:59.754296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:37:59.754296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:37:59.754296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:37:59.754296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:37:59.754296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:37:59.754296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:37:59.754296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:37:59.754296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:37:59.754296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:37:59.755585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:37:59.755585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 08:37:59.755585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 08:37:59.755585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 08:37:59.755585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 08:37:59.755585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:37:59.755585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:37:59.755585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:37:59.755585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:37:59.755585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 could not be found. Jul 20 08:37:59.755585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:37:59.755585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:37:59.755585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:37:59.755585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:37:59.755585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:37:59.755585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:37:59.755585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:37:59.755585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:37:59.755585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 could not be found. Jul 20 08:37:59.755585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:37:59.757029 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-22c4b178-e29d-4cad-b467-b5dce62591b5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Returning 404 to user: Instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:37:59.757029 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-22c4b178-e29d-4cad-b467-b5dce62591b5 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70" status: 404 len: 111 microversion: 2.1 time: 0.033091 Jul 20 08:37:59.757029 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 678/1307] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:37:59 2022] DELETE /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:37:59.763969 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-54b80057-5072-4d59-8b96-1d1d237a6de1 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:37:59.764851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-54b80057-5072-4d59-8b96-1d1d237a6de1 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:37:59.771278 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-54b80057-5072-4d59-8b96-1d1d237a6de1 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:59.771720 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-54b80057-5072-4d59-8b96-1d1d237a6de1 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:59.772505 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-54b80057-5072-4d59-8b96-1d1d237a6de1 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:37:59.772944 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-54b80057-5072-4d59-8b96-1d1d237a6de1 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:37:59.787471 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-54b80057-5072-4d59-8b96-1d1d237a6de1 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] HTTP exception thrown: Instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 could not be found. Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-54b80057-5072-4d59-8b96-1d1d237a6de1 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Request method failure captured: Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 HTTP/1.1 Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17wo_BrUuwgwkV5wSxfZ0PaEG2smOS_3EaSmbvX4GHgTNQJGFIGXS1ZXUvj4vWqiSJpk8D_ha_FxABCakdU3k6UT4ptF0CTt99RQTgVHLBXvgUDjNWjGe3Q-hDMJHG9ykhPcUSN7CLIpMh7HYSIJjlzKs1-rXREybKGWkkYUQQHIgYM Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: fa4764ea3c4f4bf98ea56ee0798adfdc Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-AttachVolumeTestJSON-1815855654 Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:37:59.789292 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:37:59.790883 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fa4764ea3c4f4bf98ea56ee0798adfdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fa4764ea3c4f4bf98ea56ee0798adfdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fa4764ea3c4f4bf98ea56ee0798adfdc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fa4764ea3c4f4bf98ea56ee0798adfdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:37:59.790883 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-AttachVolumeTestJSON-1815855654 Jul 20 08:37:59.790883 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: fa4764ea3c4f4bf98ea56ee0798adfdc Jul 20 08:37:59.790883 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1815855654 Jul 20 08:37:59.790883 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-AttachVolumeTestJSON-1815855654-project Jul 20 08:37:59.790883 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:37:59.790883 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:37:59.790883 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: b2326ff15f294e15806d8a564770b35e Jul 20 08:37:59.790883 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-AttachVolumeTestJSON-1815855654-project Jul 20 08:37:59.790883 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: > Jul 20 08:37:59.790883 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 could not be found. Jul 20 08:37:59.790883 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': '4a397563-630d-4bdc-b9e3-5c4b6c5f3d70'} Jul 20 08:37:59.791721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:37:59.791721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:37:59.791721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:37:59.791721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:37:59.791721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:37:59.791721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:37:59.791721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:37:59.791721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:37:59.791721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:37:59.791721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:37:59.791721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 could not be found. Jul 20 08:37:59.791721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:37:59.791721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:37:59.791721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:37:59.791721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:37:59.791721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:37:59.791721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:37:59.791721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:37:59.791721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:37:59.791721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:37:59.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:37:59.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:37:59.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:37:59.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:37:59.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:37:59.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:37:59.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:37:59.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 could not be found. Jul 20 08:37:59.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:37:59.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:37:59.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:37:59.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:37:59.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:37:59.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:37:59.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:37:59.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:37:59.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 could not be found. Jul 20 08:37:59.792993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:37:59.794065 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-54b80057-5072-4d59-8b96-1d1d237a6de1 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Returning 404 to user: Instance 4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:37:59.794065 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-54b80057-5072-4d59-8b96-1d1d237a6de1 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70" status: 404 len: 111 microversion: 2.1 time: 0.031430 Jul 20 08:37:59.794065 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 630/1308] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:37:59 2022] GET /compute/v2.1/servers/4a397563-630d-4bdc-b9e3-5c4b6c5f3d70 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:38:00.983299 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f8cfe62a-1f6a-4b04-92b4-caee81dbc057 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:00.983851 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f8cfe62a-1f6a-4b04-92b4-caee81dbc057 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:00.991185 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f8cfe62a-1f6a-4b04-92b4-caee81dbc057 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:00.991779 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f8cfe62a-1f6a-4b04-92b4-caee81dbc057 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:00.992665 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f8cfe62a-1f6a-4b04-92b4-caee81dbc057 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:00.993202 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f8cfe62a-1f6a-4b04-92b4-caee81dbc057 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:01.010213 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-f8cfe62a-1f6a-4b04-92b4-caee81dbc057 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] HTTP exception thrown: Instance c374291c-87f7-45dd-9391-807207d937bc could not be found. Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f8cfe62a-1f6a-4b04-92b4-caee81dbc057 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Request method failure captured: Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: DELETE /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc HTTP/1.1 Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wo_BrUuwgwkV5wSxfZ0PaEG2smOS_3EaSmbvX4GHgTNQJGFIGXS1ZXUvj4vWqiSJpk8D_ha_FxABCakdU3k6UT4ptF0CTt99RQTgVHLBXvgUDjNWjGe3Q-hDMJHG9ykhPcUSN7CLIpMh7HYSIJjlzKs1-rXREybKGWkkYUQQHIgYM Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: fa4764ea3c4f4bf98ea56ee0798adfdc Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-AttachVolumeTestJSON-1815855654 Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:38:01.011939 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:38:01.014429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fa4764ea3c4f4bf98ea56ee0798adfdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fa4764ea3c4f4bf98ea56ee0798adfdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fa4764ea3c4f4bf98ea56ee0798adfdc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fa4764ea3c4f4bf98ea56ee0798adfdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:38:01.014429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-AttachVolumeTestJSON-1815855654 Jul 20 08:38:01.014429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: fa4764ea3c4f4bf98ea56ee0798adfdc Jul 20 08:38:01.014429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1815855654 Jul 20 08:38:01.014429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-AttachVolumeTestJSON-1815855654-project Jul 20 08:38:01.014429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:38:01.014429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:38:01.014429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: b2326ff15f294e15806d8a564770b35e Jul 20 08:38:01.014429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-AttachVolumeTestJSON-1815855654-project Jul 20 08:38:01.014429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:38:01.014429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance c374291c-87f7-45dd-9391-807207d937bc could not be found. Jul 20 08:38:01.014429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': 'c374291c-87f7-45dd-9391-807207d937bc'} Jul 20 08:38:01.015669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:38:01.015669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:01.015669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:38:01.015669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:38:01.015669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:38:01.015669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:38:01.015669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:38:01.015669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:38:01.015669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:38:01.015669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:38:01.015669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c374291c-87f7-45dd-9391-807207d937bc could not be found. Jul 20 08:38:01.015669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:38:01.015669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:38:01.015669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:38:01.015669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:01.015669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:38:01.015669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:38:01.015669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:38:01.015669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:38:01.015669 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:38:01.017653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:38:01.017653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 08:38:01.017653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 08:38:01.017653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 08:38:01.017653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 08:38:01.017653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:38:01.017653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:38:01.017653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:38:01.017653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:38:01.017653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c374291c-87f7-45dd-9391-807207d937bc could not be found. Jul 20 08:38:01.017653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:38:01.017653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:38:01.017653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:38:01.017653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:01.017653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:38:01.017653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:38:01.017653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:38:01.017653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:38:01.017653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c374291c-87f7-45dd-9391-807207d937bc could not be found. Jul 20 08:38:01.017653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:38:01.019309 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f8cfe62a-1f6a-4b04-92b4-caee81dbc057 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Returning 404 to user: Instance c374291c-87f7-45dd-9391-807207d937bc could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:38:01.019309 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f8cfe62a-1f6a-4b04-92b4-caee81dbc057 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 404 len: 111 microversion: 2.1 time: 0.034169 Jul 20 08:38:01.019309 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 679/1309] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:38:00 2022] DELETE /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:38:01.025277 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d568a7c4-7d5d-4146-bf27-3616a3bf7654 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:01.026028 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d568a7c4-7d5d-4146-bf27-3616a3bf7654 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] [instance: c374291c-87f7-45dd-9391-807207d937bc] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:01.033750 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d568a7c4-7d5d-4146-bf27-3616a3bf7654 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:01.034206 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d568a7c4-7d5d-4146-bf27-3616a3bf7654 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:01.035108 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d568a7c4-7d5d-4146-bf27-3616a3bf7654 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:01.035553 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d568a7c4-7d5d-4146-bf27-3616a3bf7654 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:01.054196 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-d568a7c4-7d5d-4146-bf27-3616a3bf7654 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] HTTP exception thrown: Instance c374291c-87f7-45dd-9391-807207d937bc could not be found. Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d568a7c4-7d5d-4146-bf27-3616a3bf7654 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Request method failure captured: Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc HTTP/1.1 Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17wo_BrUuwgwkV5wSxfZ0PaEG2smOS_3EaSmbvX4GHgTNQJGFIGXS1ZXUvj4vWqiSJpk8D_ha_FxABCakdU3k6UT4ptF0CTt99RQTgVHLBXvgUDjNWjGe3Q-hDMJHG9ykhPcUSN7CLIpMh7HYSIJjlzKs1-rXREybKGWkkYUQQHIgYM Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: fa4764ea3c4f4bf98ea56ee0798adfdc Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-AttachVolumeTestJSON-1815855654 Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:38:01.055924 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:38:01.058455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fa4764ea3c4f4bf98ea56ee0798adfdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fa4764ea3c4f4bf98ea56ee0798adfdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fa4764ea3c4f4bf98ea56ee0798adfdc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fa4764ea3c4f4bf98ea56ee0798adfdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:38:01.058455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-AttachVolumeTestJSON-1815855654 Jul 20 08:38:01.058455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: fa4764ea3c4f4bf98ea56ee0798adfdc Jul 20 08:38:01.058455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1815855654 Jul 20 08:38:01.058455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-AttachVolumeTestJSON-1815855654-project Jul 20 08:38:01.058455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:38:01.058455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:38:01.058455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: b2326ff15f294e15806d8a564770b35e Jul 20 08:38:01.058455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-AttachVolumeTestJSON-1815855654-project Jul 20 08:38:01.058455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: > Jul 20 08:38:01.058455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Instance c374291c-87f7-45dd-9391-807207d937bc could not be found. Jul 20 08:38:01.058455 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': 'c374291c-87f7-45dd-9391-807207d937bc'} Jul 20 08:38:01.059919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:38:01.059919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:01.059919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:38:01.059919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:38:01.059919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:38:01.059919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:38:01.059919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:38:01.059919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:38:01.059919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:38:01.059919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:38:01.059919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c374291c-87f7-45dd-9391-807207d937bc could not be found. Jul 20 08:38:01.059919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:38:01.059919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:38:01.059919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:38:01.059919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:01.059919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:38:01.059919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:38:01.059919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:38:01.059919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:38:01.059919 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:38:01.062350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:38:01.062350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:38:01.062350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:38:01.062350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:38:01.062350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:38:01.062350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:38:01.062350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:38:01.062350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c374291c-87f7-45dd-9391-807207d937bc could not be found. Jul 20 08:38:01.062350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:38:01.062350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:38:01.062350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:38:01.062350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:01.062350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:38:01.062350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:38:01.062350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:38:01.062350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:38:01.062350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c374291c-87f7-45dd-9391-807207d937bc could not be found. Jul 20 08:38:01.062350 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:38:01.064594 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d568a7c4-7d5d-4146-bf27-3616a3bf7654 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] Returning 404 to user: Instance c374291c-87f7-45dd-9391-807207d937bc could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:38:01.064594 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d568a7c4-7d5d-4146-bf27-3616a3bf7654 tempest-AttachVolumeTestJSON-1815855654 tempest-AttachVolumeTestJSON-1815855654-project] 10.222.0.64 "GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc" status: 404 len: 111 microversion: 2.1 time: 0.037784 Jul 20 08:38:01.064594 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 631/1310] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:38:01 2022] GET /compute/v2.1/servers/c374291c-87f7-45dd-9391-807207d937bc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:38:39.011788 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-61c68ef0-b5fa-4e94-90ac-209a5b72361d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:39.012372 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-61c68ef0-b5fa-4e94-90ac-209a5b72361d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:39.014709 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=17 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:38:39.015358 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:38:39.020891 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-61c68ef0-b5fa-4e94-90ac-209a5b72361d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:39.021341 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-61c68ef0-b5fa-4e94-90ac-209a5b72361d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:39.022114 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-61c68ef0-b5fa-4e94-90ac-209a5b72361d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:39.022551 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-61c68ef0-b5fa-4e94-90ac-209a5b72361d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:39.049558 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-61c68ef0-b5fa-4e94-90ac-209a5b72361d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef/ips" status: 200 len: 149 microversion: 2.1 time: 0.042241 Jul 20 08:38:39.050157 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 680/1311] 10.222.0.64 () {58 vars in 1247 bytes} [Wed Jul 20 08:38:39 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:38:40.789042 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-25ef9bc3-d4f5-42ce-84a1-211dd1d0bbcb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:40.790567 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-25ef9bc3-d4f5-42ce-84a1-211dd1d0bbcb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:40.792902 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:38:40.793584 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:38:40.800005 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-25ef9bc3-d4f5-42ce-84a1-211dd1d0bbcb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:40.800461 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-25ef9bc3-d4f5-42ce-84a1-211dd1d0bbcb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:40.801256 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-25ef9bc3-d4f5-42ce-84a1-211dd1d0bbcb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:40.801848 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-25ef9bc3-d4f5-42ce-84a1-211dd1d0bbcb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:40.834326 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-25ef9bc3-d4f5-42ce-84a1-211dd1d0bbcb tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049478 Jul 20 08:38:40.834925 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 632/1312] 10.222.0.64 () {60 vars in 1342 bytes} [Wed Jul 20 08:38:40 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:38:40.896191 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0726a4f4-9590-44fb-9918-31ccb67b8afd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:40.896748 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0726a4f4-9590-44fb-9918-31ccb67b8afd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:40.904578 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0726a4f4-9590-44fb-9918-31ccb67b8afd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:40.905025 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0726a4f4-9590-44fb-9918-31ccb67b8afd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:40.905805 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0726a4f4-9590-44fb-9918-31ccb67b8afd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:40.906241 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0726a4f4-9590-44fb-9918-31ccb67b8afd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:40.935427 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0726a4f4-9590-44fb-9918-31ccb67b8afd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Going to try to terminate instance {{(pid=117828) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:38:41.018727 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0726a4f4-9590-44fb-9918-31ccb67b8afd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 204 len: 0 microversion: 2.20 time: 0.126179 Jul 20 08:38:41.019307 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 681/1313] 10.222.0.64 () {60 vars in 1279 bytes} [Wed Jul 20 08:38:40 2022] DELETE /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 08:38:41.028562 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5654d014-926c-48ce-b1ed-cfb9adaf04cd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:41.029177 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5654d014-926c-48ce-b1ed-cfb9adaf04cd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:41.035399 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5654d014-926c-48ce-b1ed-cfb9adaf04cd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:41.035846 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5654d014-926c-48ce-b1ed-cfb9adaf04cd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:41.036648 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5654d014-926c-48ce-b1ed-cfb9adaf04cd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:41.037078 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5654d014-926c-48ce-b1ed-cfb9adaf04cd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:41.175645 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5654d014-926c-48ce-b1ed-cfb9adaf04cd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:38:41.184441 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5654d014-926c-48ce-b1ed-cfb9adaf04cd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:38:41.185946 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-5654d014-926c-48ce-b1ed-cfb9adaf04cd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:38:41.187199 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5654d014-926c-48ce-b1ed-cfb9adaf04cd tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1725 microversion: 2.20 time: 0.163275 Jul 20 08:38:41.187773 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 633/1314] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:38:41 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:38:42.207030 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5929fc7a-f298-44ae-9089-02fc19bb6af2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:42.208106 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-5929fc7a-f298-44ae-9089-02fc19bb6af2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:42.216799 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5929fc7a-f298-44ae-9089-02fc19bb6af2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:42.217430 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5929fc7a-f298-44ae-9089-02fc19bb6af2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:42.218365 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5929fc7a-f298-44ae-9089-02fc19bb6af2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:42.219014 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5929fc7a-f298-44ae-9089-02fc19bb6af2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:42.372163 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5929fc7a-f298-44ae-9089-02fc19bb6af2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:38:42.384279 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5929fc7a-f298-44ae-9089-02fc19bb6af2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:38:42.385791 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-5929fc7a-f298-44ae-9089-02fc19bb6af2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:38:42.386995 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-5929fc7a-f298-44ae-9089-02fc19bb6af2 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1725 microversion: 2.20 time: 0.185198 Jul 20 08:38:42.387559 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 682/1315] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:38:42 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:38:42.488557 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-48f87011-fca5-403b-a3c2-ef47f4649307 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e3d5492-fba0-4e73-9a03-beb7b09904b8"}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:38:42.489627 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-48f87011-fca5-403b-a3c2-ef47f4649307 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:42.496588 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-48f87011-fca5-403b-a3c2-ef47f4649307 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:42.497033 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-48f87011-fca5-403b-a3c2-ef47f4649307 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:42.497848 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-48f87011-fca5-403b-a3c2-ef47f4649307 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:42.498287 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-48f87011-fca5-403b-a3c2-ef47f4649307 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:43.407195 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b6b352a4-4a12-46d5-aa08-83fd8856a115 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:43.407991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b6b352a4-4a12-46d5-aa08-83fd8856a115 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:43.416139 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b6b352a4-4a12-46d5-aa08-83fd8856a115 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:43.416661 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b6b352a4-4a12-46d5-aa08-83fd8856a115 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:43.417463 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b6b352a4-4a12-46d5-aa08-83fd8856a115 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:43.418108 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b6b352a4-4a12-46d5-aa08-83fd8856a115 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:43.530698 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-48f87011-fca5-403b-a3c2-ef47f4649307 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "POST /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.045760 Jul 20 08:38:43.534323 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 634/1316] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Jul 20 08:38:42 2022] POST /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef/os-volume_attachments => generated 194 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:38:43.576528 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b6b352a4-4a12-46d5-aa08-83fd8856a115 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:38:43.585410 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b6b352a4-4a12-46d5-aa08-83fd8856a115 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:38:43.587526 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b6b352a4-4a12-46d5-aa08-83fd8856a115 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:38:43.589495 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b6b352a4-4a12-46d5-aa08-83fd8856a115 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1725 microversion: 2.20 time: 0.186382 Jul 20 08:38:43.596607 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 683/1317] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:38:43 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 08:38:44.224130 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-a68d89ae-89c2-483a-a7ba-ecea6de17997 req-6db52478-5e6d-4c33-9130-cbd0571645b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9589ff-3f5c-4537-9fde-1b5e676b7e09", "name": "network-vif-deleted", "tag": "08b8e9ae-c7b3-47d7-8038-a5fdfb1440e4"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:38:44.234966 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-a68d89ae-89c2-483a-a7ba-ecea6de17997 req-6db52478-5e6d-4c33-9130-cbd0571645b6 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:44.235509 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-a68d89ae-89c2-483a-a7ba-ecea6de17997 req-6db52478-5e6d-4c33-9130-cbd0571645b6 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:44.249103 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-a68d89ae-89c2-483a-a7ba-ecea6de17997 req-6db52478-5e6d-4c33-9130-cbd0571645b6 service nova] Creating event network-vif-deleted:08b8e9ae-c7b3-47d7-8038-a5fdfb1440e4 for instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 on hv-cinder-82308 Jul 20 08:38:44.255335 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-a68d89ae-89c2-483a-a7ba-ecea6de17997 req-6db52478-5e6d-4c33-9130-cbd0571645b6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037352 Jul 20 08:38:44.256256 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 635/1318] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:38:44.608627 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-835ca1c2-64a7-40de-bec5-06acf60a1f6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:44.609795 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-835ca1c2-64a7-40de-bec5-06acf60a1f6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:44.616733 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-835ca1c2-64a7-40de-bec5-06acf60a1f6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:44.617323 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-835ca1c2-64a7-40de-bec5-06acf60a1f6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:44.618988 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-835ca1c2-64a7-40de-bec5-06acf60a1f6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:44.619487 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-835ca1c2-64a7-40de-bec5-06acf60a1f6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:44.656947 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-835ca1c2-64a7-40de-bec5-06acf60a1f6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:44.657848 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-835ca1c2-64a7-40de-bec5-06acf60a1f6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:44.658685 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.objects.instance [None req-835ca1c2-64a7-40de-bec5-06acf60a1f6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lazy-loading 'fault' on Instance uuid 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 {{(pid=117828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:38:44.709743 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-835ca1c2-64a7-40de-bec5-06acf60a1f6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:38:44.721049 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-835ca1c2-64a7-40de-bec5-06acf60a1f6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:38:44.722972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-835ca1c2-64a7-40de-bec5-06acf60a1f6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fb5f0f7e59dd4c548a6ea72bb25f1ebb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80faf6362e244bb992ffb6058ceeefda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:38:44.724165 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-835ca1c2-64a7-40de-bec5-06acf60a1f6d tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 200 len: 1372 microversion: 2.20 time: 0.119855 Jul 20 08:38:44.724730 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 684/1319] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:38:44 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 1372 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 08:38:45.743499 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-53be490b-bbbd-4bd8-872a-53368749da4f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:45.744412 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-53be490b-bbbd-4bd8-872a-53368749da4f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:45.751715 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-53be490b-bbbd-4bd8-872a-53368749da4f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:45.752095 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-53be490b-bbbd-4bd8-872a-53368749da4f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:45.752891 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-53be490b-bbbd-4bd8-872a-53368749da4f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:45.753333 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-53be490b-bbbd-4bd8-872a-53368749da4f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:45.770167 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-53be490b-bbbd-4bd8-872a-53368749da4f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] HTTP exception thrown: Instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 could not be found. Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-53be490b-bbbd-4bd8-872a-53368749da4f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Request method failure captured: Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 HTTP/1.1 Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17wMdqJgraEhg-CmqjQbcQK9jOfe_AMqFkk3FxIRd2RzO6SlDEPybLrXL7xLVZuDbuSsCxTxhq6XF-I5nVnfRSrncR8_aNu5meRhkEpX7LSQz6rznOlgkFbfMnn-Q8j2lgnkjO5VV1oQNYYNR5nZCsv74kqMwsDRwL9aCRxe8DUC1wQ Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: 80faf6362e244bb992ffb6058ceeefda Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2013247676 Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:38:45.771970 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:38:45.774044 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/80faf6362e244bb992ffb6058ceeefda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/80faf6362e244bb992ffb6058ceeefda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_80faf6362e244bb992ffb6058ceeefda", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/80faf6362e244bb992ffb6058ceeefda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:38:45.774044 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2013247676 Jul 20 08:38:45.774044 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: 80faf6362e244bb992ffb6058ceeefda Jul 20 08:38:45.774044 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2013247676 Jul 20 08:38:45.774044 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-AttachVolumeShelveTestJSON-2013247676-project Jul 20 08:38:45.774044 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:38:45.774044 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:38:45.774044 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: fb5f0f7e59dd4c548a6ea72bb25f1ebb Jul 20 08:38:45.774044 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2013247676-project Jul 20 08:38:45.774044 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: > Jul 20 08:38:45.774044 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 could not be found. Jul 20 08:38:45.774044 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': '0f9589ff-3f5c-4537-9fde-1b5e676b7e09'} Jul 20 08:38:45.775675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:38:45.775675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:45.775675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:38:45.775675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:38:45.775675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:38:45.775675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:38:45.775675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:38:45.775675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:38:45.775675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:38:45.775675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:38:45.775675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 could not be found. Jul 20 08:38:45.775675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:38:45.775675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:38:45.775675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:38:45.775675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:45.775675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:38:45.775675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:38:45.775675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:38:45.775675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:38:45.775675 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:38:45.777406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:38:45.777406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:38:45.777406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:38:45.777406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:38:45.777406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:38:45.777406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:38:45.777406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:38:45.777406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 could not be found. Jul 20 08:38:45.777406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:38:45.777406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:38:45.777406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:38:45.777406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:45.777406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:38:45.777406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:38:45.777406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:38:45.777406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:38:45.777406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 could not be found. Jul 20 08:38:45.777406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:38:45.778914 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-53be490b-bbbd-4bd8-872a-53368749da4f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Returning 404 to user: Instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:38:45.778914 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-53be490b-bbbd-4bd8-872a-53368749da4f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 404 len: 111 microversion: 2.20 time: 0.035493 Jul 20 08:38:45.778914 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 636/1320] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:38:45 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 08:38:45.785057 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-69b9f89b-c488-4b17-a060-d9382a81c8a9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '.version_select at 0x7fe39925b790>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:45.803958 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-69b9f89b-c488-4b17-a060-d9382a81c8a9 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771475061" status: 204 len: 0 microversion: 2.20 time: 0.022742 Jul 20 08:38:45.804599 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 685/1321] 10.222.0.64 () {60 vars in 1261 bytes} [Wed Jul 20 08:38:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1771475061 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 08:38:47.659036 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-470d7c48-89d0-4823-9a5f-74757347bf9f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:47.659603 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-470d7c48-89d0-4823-9a5f-74757347bf9f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:47.666874 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-470d7c48-89d0-4823-9a5f-74757347bf9f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:47.667329 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-470d7c48-89d0-4823-9a5f-74757347bf9f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:47.668108 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-470d7c48-89d0-4823-9a5f-74757347bf9f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:47.668540 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-470d7c48-89d0-4823-9a5f-74757347bf9f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:47.683612 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-470d7c48-89d0-4823-9a5f-74757347bf9f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] HTTP exception thrown: Instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 could not be found. Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-470d7c48-89d0-4823-9a5f-74757347bf9f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Request method failure captured: Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: DELETE /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 HTTP/1.1 Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17wMdqJgraEhg-CmqjQbcQK9jOfe_AMqFkk3FxIRd2RzO6SlDEPybLrXL7xLVZuDbuSsCxTxhq6XF-I5nVnfRSrncR8_aNu5meRhkEpX7LSQz6rznOlgkFbfMnn-Q8j2lgnkjO5VV1oQNYYNR5nZCsv74kqMwsDRwL9aCRxe8DUC1wQ Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: 80faf6362e244bb992ffb6058ceeefda Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2013247676 Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:38:47.685357 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:38:47.686991 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/80faf6362e244bb992ffb6058ceeefda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/80faf6362e244bb992ffb6058ceeefda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_80faf6362e244bb992ffb6058ceeefda", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/80faf6362e244bb992ffb6058ceeefda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:38:47.686991 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2013247676 Jul 20 08:38:47.686991 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: 80faf6362e244bb992ffb6058ceeefda Jul 20 08:38:47.686991 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2013247676 Jul 20 08:38:47.686991 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-AttachVolumeShelveTestJSON-2013247676-project Jul 20 08:38:47.686991 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:38:47.686991 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:38:47.686991 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: fb5f0f7e59dd4c548a6ea72bb25f1ebb Jul 20 08:38:47.686991 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2013247676-project Jul 20 08:38:47.686991 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: > Jul 20 08:38:47.686991 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 could not be found. Jul 20 08:38:47.686991 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': '0f9589ff-3f5c-4537-9fde-1b5e676b7e09'} Jul 20 08:38:47.687861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:38:47.687861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:47.687861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:38:47.687861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:38:47.687861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:38:47.687861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:38:47.687861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:38:47.687861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:38:47.687861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:38:47.687861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:38:47.687861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 could not be found. Jul 20 08:38:47.687861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:38:47.687861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:38:47.687861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:38:47.687861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:47.687861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:38:47.687861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:38:47.687861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:38:47.687861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:38:47.687861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:38:47.689245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:38:47.689245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 08:38:47.689245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 08:38:47.689245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 08:38:47.689245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 08:38:47.689245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:38:47.689245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:38:47.689245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:38:47.689245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:38:47.689245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 could not be found. Jul 20 08:38:47.689245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:38:47.689245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:38:47.689245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:38:47.689245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:47.689245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:38:47.689245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:38:47.689245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:38:47.689245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:38:47.689245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 could not be found. Jul 20 08:38:47.689245 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:38:47.690601 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-470d7c48-89d0-4823-9a5f-74757347bf9f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Returning 404 to user: Instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:38:47.690601 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-470d7c48-89d0-4823-9a5f-74757347bf9f tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 404 len: 111 microversion: 2.20 time: 0.031632 Jul 20 08:38:47.690601 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 637/1322] 10.222.0.64 () {60 vars in 1279 bytes} [Wed Jul 20 08:38:47 2022] DELETE /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 08:38:47.697385 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-bb6bed82-16f8-4489-b291-cc7810c2dfd6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:47.697990 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-bb6bed82-16f8-4489-b291-cc7810c2dfd6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 0f9589ff-3f5c-4537-9fde-1b5e676b7e09] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:47.707216 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bb6bed82-16f8-4489-b291-cc7810c2dfd6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:47.707658 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bb6bed82-16f8-4489-b291-cc7810c2dfd6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:47.708419 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bb6bed82-16f8-4489-b291-cc7810c2dfd6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:47.708847 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-bb6bed82-16f8-4489-b291-cc7810c2dfd6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:47.722551 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-bb6bed82-16f8-4489-b291-cc7810c2dfd6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] HTTP exception thrown: Instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 could not be found. Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-bb6bed82-16f8-4489-b291-cc7810c2dfd6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Request method failure captured: Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 HTTP/1.1 Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wMdqJgraEhg-CmqjQbcQK9jOfe_AMqFkk3FxIRd2RzO6SlDEPybLrXL7xLVZuDbuSsCxTxhq6XF-I5nVnfRSrncR8_aNu5meRhkEpX7LSQz6rznOlgkFbfMnn-Q8j2lgnkjO5VV1oQNYYNR5nZCsv74kqMwsDRwL9aCRxe8DUC1wQ Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: 80faf6362e244bb992ffb6058ceeefda Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2013247676 Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:38:47.724293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:38:47.726038 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/80faf6362e244bb992ffb6058ceeefda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/80faf6362e244bb992ffb6058ceeefda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_80faf6362e244bb992ffb6058ceeefda", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/80faf6362e244bb992ffb6058ceeefda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:38:47.726038 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2013247676 Jul 20 08:38:47.726038 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: 80faf6362e244bb992ffb6058ceeefda Jul 20 08:38:47.726038 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2013247676 Jul 20 08:38:47.726038 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-AttachVolumeShelveTestJSON-2013247676-project Jul 20 08:38:47.726038 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:38:47.726038 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:38:47.726038 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: fb5f0f7e59dd4c548a6ea72bb25f1ebb Jul 20 08:38:47.726038 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2013247676-project Jul 20 08:38:47.726038 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:38:47.726038 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 could not be found. Jul 20 08:38:47.726038 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': '0f9589ff-3f5c-4537-9fde-1b5e676b7e09'} Jul 20 08:38:47.726910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:38:47.726910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:47.726910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:38:47.726910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:38:47.726910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:38:47.726910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:38:47.726910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:38:47.726910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:38:47.726910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:38:47.726910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:38:47.726910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 could not be found. Jul 20 08:38:47.726910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:38:47.726910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:38:47.726910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:38:47.726910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:47.726910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:38:47.726910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:38:47.726910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:38:47.726910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:38:47.726910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:38:47.729429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:38:47.729429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:38:47.729429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:38:47.729429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:38:47.729429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:38:47.729429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:38:47.729429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:38:47.729429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 could not be found. Jul 20 08:38:47.729429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:38:47.729429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:38:47.729429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:38:47.729429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:47.729429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:38:47.729429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:38:47.729429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:38:47.729429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:38:47.729429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 could not be found. Jul 20 08:38:47.729429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:38:47.731118 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-bb6bed82-16f8-4489-b291-cc7810c2dfd6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Returning 404 to user: Instance 0f9589ff-3f5c-4537-9fde-1b5e676b7e09 could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:38:47.731118 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-bb6bed82-16f8-4489-b291-cc7810c2dfd6 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09" status: 404 len: 111 microversion: 2.20 time: 0.033758 Jul 20 08:38:47.731118 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 686/1323] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:38:47 2022] GET /compute/v2.1/servers/0f9589ff-3f5c-4537-9fde-1b5e676b7e09 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 08:38:48.872925 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e3bf6de1-2778-4775-ae08-d7f79e9f0e80 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:48.873482 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e3bf6de1-2778-4775-ae08-d7f79e9f0e80 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:48.880073 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e3bf6de1-2778-4775-ae08-d7f79e9f0e80 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:48.880525 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e3bf6de1-2778-4775-ae08-d7f79e9f0e80 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:48.881299 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e3bf6de1-2778-4775-ae08-d7f79e9f0e80 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:48.881730 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e3bf6de1-2778-4775-ae08-d7f79e9f0e80 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:48.897041 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-e3bf6de1-2778-4775-ae08-d7f79e9f0e80 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] HTTP exception thrown: Instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 could not be found. Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e3bf6de1-2778-4775-ae08-d7f79e9f0e80 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Request method failure captured: Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: DELETE /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 HTTP/1.1 Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17wMdqJgraEhg-CmqjQbcQK9jOfe_AMqFkk3FxIRd2RzO6SlDEPybLrXL7xLVZuDbuSsCxTxhq6XF-I5nVnfRSrncR8_aNu5meRhkEpX7LSQz6rznOlgkFbfMnn-Q8j2lgnkjO5VV1oQNYYNR5nZCsv74kqMwsDRwL9aCRxe8DUC1wQ Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: 80faf6362e244bb992ffb6058ceeefda Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2013247676 Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:38:48.898624 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:38:48.901214 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/80faf6362e244bb992ffb6058ceeefda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/80faf6362e244bb992ffb6058ceeefda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_80faf6362e244bb992ffb6058ceeefda", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/80faf6362e244bb992ffb6058ceeefda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:38:48.901214 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2013247676 Jul 20 08:38:48.901214 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: 80faf6362e244bb992ffb6058ceeefda Jul 20 08:38:48.901214 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2013247676 Jul 20 08:38:48.901214 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-AttachVolumeShelveTestJSON-2013247676-project Jul 20 08:38:48.901214 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:38:48.901214 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:38:48.901214 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: fb5f0f7e59dd4c548a6ea72bb25f1ebb Jul 20 08:38:48.901214 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2013247676-project Jul 20 08:38:48.901214 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: > Jul 20 08:38:48.901214 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 could not be found. Jul 20 08:38:48.901214 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': '21b295e0-508c-4cd5-b18f-3b808c0ff265'} Jul 20 08:38:48.902174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:38:48.902174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:48.902174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:38:48.902174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:38:48.902174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:38:48.902174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:38:48.902174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:38:48.902174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:38:48.902174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:38:48.902174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:38:48.902174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 could not be found. Jul 20 08:38:48.902174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:38:48.902174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:38:48.902174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:38:48.902174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:48.902174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:38:48.902174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:38:48.902174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:38:48.902174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:38:48.902174 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:38:48.903555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:38:48.903555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 08:38:48.903555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 08:38:48.903555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 08:38:48.903555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 08:38:48.903555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:38:48.903555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:38:48.903555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:38:48.903555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:38:48.903555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 could not be found. Jul 20 08:38:48.903555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:38:48.903555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:38:48.903555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:38:48.903555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:48.903555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:38:48.903555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:38:48.903555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:38:48.903555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:38:48.903555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 could not be found. Jul 20 08:38:48.903555 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:38:48.905022 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e3bf6de1-2778-4775-ae08-d7f79e9f0e80 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Returning 404 to user: Instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:38:48.905022 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e3bf6de1-2778-4775-ae08-d7f79e9f0e80 tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "DELETE /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 404 len: 111 microversion: 2.20 time: 0.034250 Jul 20 08:38:48.905022 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 638/1324] 10.222.0.64 () {60 vars in 1279 bytes} [Wed Jul 20 08:38:48 2022] DELETE /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 08:38:48.909458 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-74c90284-641d-4d59-996e-609f75750e2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:48.910062 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-74c90284-641d-4d59-996e-609f75750e2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] [instance: 21b295e0-508c-4cd5-b18f-3b808c0ff265] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:48.917058 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-74c90284-641d-4d59-996e-609f75750e2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:48.917550 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-74c90284-641d-4d59-996e-609f75750e2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:48.918332 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-74c90284-641d-4d59-996e-609f75750e2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:48.918807 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-74c90284-641d-4d59-996e-609f75750e2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:48.934526 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-74c90284-641d-4d59-996e-609f75750e2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] HTTP exception thrown: Instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 could not be found. Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-74c90284-641d-4d59-996e-609f75750e2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Request method failure captured: Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 HTTP/1.1 Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wMdqJgraEhg-CmqjQbcQK9jOfe_AMqFkk3FxIRd2RzO6SlDEPybLrXL7xLVZuDbuSsCxTxhq6XF-I5nVnfRSrncR8_aNu5meRhkEpX7LSQz6rznOlgkFbfMnn-Q8j2lgnkjO5VV1oQNYYNR5nZCsv74kqMwsDRwL9aCRxe8DUC1wQ Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: 80faf6362e244bb992ffb6058ceeefda Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2013247676 Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:38:48.936124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:38:48.937843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/80faf6362e244bb992ffb6058ceeefda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/80faf6362e244bb992ffb6058ceeefda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_80faf6362e244bb992ffb6058ceeefda", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/80faf6362e244bb992ffb6058ceeefda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:38:48.937843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2013247676 Jul 20 08:38:48.937843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: 80faf6362e244bb992ffb6058ceeefda Jul 20 08:38:48.937843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2013247676 Jul 20 08:38:48.937843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-AttachVolumeShelveTestJSON-2013247676-project Jul 20 08:38:48.937843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:38:48.937843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:38:48.937843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: fb5f0f7e59dd4c548a6ea72bb25f1ebb Jul 20 08:38:48.937843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2013247676-project Jul 20 08:38:48.937843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:38:48.937843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 could not be found. Jul 20 08:38:48.937843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': '21b295e0-508c-4cd5-b18f-3b808c0ff265'} Jul 20 08:38:48.938924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:38:48.938924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:48.938924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:38:48.938924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:38:48.938924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:38:48.938924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:38:48.938924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:38:48.938924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:38:48.938924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:38:48.938924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:38:48.938924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 could not be found. Jul 20 08:38:48.938924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:38:48.938924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:38:48.938924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:38:48.938924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:48.938924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:38:48.938924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:38:48.938924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:38:48.938924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:38:48.938924 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:38:48.940446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:38:48.940446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:38:48.940446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:38:48.940446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:38:48.940446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:38:48.940446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:38:48.940446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:38:48.940446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 could not be found. Jul 20 08:38:48.940446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:38:48.940446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:38:48.940446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:38:48.940446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:48.940446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:38:48.940446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:38:48.940446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:38:48.940446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:38:48.940446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 could not be found. Jul 20 08:38:48.940446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:38:48.941845 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-74c90284-641d-4d59-996e-609f75750e2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] Returning 404 to user: Instance 21b295e0-508c-4cd5-b18f-3b808c0ff265 could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:38:48.941845 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-74c90284-641d-4d59-996e-609f75750e2e tempest-AttachVolumeShelveTestJSON-2013247676 tempest-AttachVolumeShelveTestJSON-2013247676-project] 10.222.0.64 "GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265" status: 404 len: 111 microversion: 2.20 time: 0.031981 Jul 20 08:38:48.941845 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 687/1325] 10.222.0.64 () {60 vars in 1276 bytes} [Wed Jul 20 08:38:48 2022] GET /compute/v2.1/servers/21b295e0-508c-4cd5-b18f-3b808c0ff265 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 08:38:52.354790 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-4216eaf7-8d8a-4065-8fa8-9f8f9034cad4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:52.355597 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-4216eaf7-8d8a-4065-8fa8-9f8f9034cad4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:52.364341 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4216eaf7-8d8a-4065-8fa8-9f8f9034cad4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:52.364805 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4216eaf7-8d8a-4065-8fa8-9f8f9034cad4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:52.365934 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4216eaf7-8d8a-4065-8fa8-9f8f9034cad4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:52.366369 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-4216eaf7-8d8a-4065-8fa8-9f8f9034cad4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:52.456359 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.objects.instance [None req-4216eaf7-8d8a-4065-8fa8-9f8f9034cad4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lazy-loading 'services' on Instance uuid c207a53a-b0d9-4d09-8ce1-beecdf160eef {{(pid=117829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:38:52.563172 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-4216eaf7-8d8a-4065-8fa8-9f8f9034cad4 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef/os-volume_attachments/5e3d5492-fba0-4e73-9a03-beb7b09904b8" status: 202 len: 0 microversion: 2.1 time: 0.214317 Jul 20 08:38:52.564154 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 639/1326] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Jul 20 08:38:52 2022] DELETE /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef/os-volume_attachments/5e3d5492-fba0-4e73-9a03-beb7b09904b8 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:38:52.576063 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-76a216ad-8972-4d84-a0cb-c2566b03ff52 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:52.576063 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-76a216ad-8972-4d84-a0cb-c2566b03ff52 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:52.588234 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-76a216ad-8972-4d84-a0cb-c2566b03ff52 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:52.589344 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-76a216ad-8972-4d84-a0cb-c2566b03ff52 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:52.590529 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-76a216ad-8972-4d84-a0cb-c2566b03ff52 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:52.591011 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-76a216ad-8972-4d84-a0cb-c2566b03ff52 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:52.626935 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-76a216ad-8972-4d84-a0cb-c2566b03ff52 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057178 Jul 20 08:38:52.627631 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 688/1327] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Jul 20 08:38:52 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:38:53.641957 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-0d167e2b-d38b-4d60-8356-cf8da9c20ecb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:53.643765 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-0d167e2b-d38b-4d60-8356-cf8da9c20ecb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:53.661623 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0d167e2b-d38b-4d60-8356-cf8da9c20ecb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:53.661623 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0d167e2b-d38b-4d60-8356-cf8da9c20ecb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:53.663619 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0d167e2b-d38b-4d60-8356-cf8da9c20ecb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:53.664687 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0d167e2b-d38b-4d60-8356-cf8da9c20ecb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:53.708750 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-0d167e2b-d38b-4d60-8356-cf8da9c20ecb tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072242 Jul 20 08:38:53.709345 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 640/1328] 10.222.0.64 () {58 vars in 1301 bytes} [Wed Jul 20 08:38:53 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 08:38:53.776954 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-9a2f1855-3d05-4346-b0d3-9d805dacdf7d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:53.777450 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9a2f1855-3d05-4346-b0d3-9d805dacdf7d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:53.784519 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9a2f1855-3d05-4346-b0d3-9d805dacdf7d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:53.784971 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9a2f1855-3d05-4346-b0d3-9d805dacdf7d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:53.785779 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9a2f1855-3d05-4346-b0d3-9d805dacdf7d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:53.786219 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-9a2f1855-3d05-4346-b0d3-9d805dacdf7d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:53.814875 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-9a2f1855-3d05-4346-b0d3-9d805dacdf7d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Going to try to terminate instance {{(pid=117828) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:38:53.910077 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-9a2f1855-3d05-4346-b0d3-9d805dacdf7d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 204 len: 0 microversion: 2.1 time: 0.137434 Jul 20 08:38:53.910804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 689/1329] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:38:53 2022] DELETE /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:38:53.920363 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3220426f-0fca-46d7-a598-413df79f5660 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:53.921358 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3220426f-0fca-46d7-a598-413df79f5660 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:53.928030 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3220426f-0fca-46d7-a598-413df79f5660 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:53.928482 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3220426f-0fca-46d7-a598-413df79f5660 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:53.929260 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3220426f-0fca-46d7-a598-413df79f5660 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:53.929721 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3220426f-0fca-46d7-a598-413df79f5660 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:54.092958 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-3220426f-0fca-46d7-a598-413df79f5660 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:38:54.103353 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3220426f-0fca-46d7-a598-413df79f5660 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1681 microversion: 2.1 time: 0.185998 Jul 20 08:38:54.103353 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 641/1330] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:38:53 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:38:55.124107 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-4ad3a1b6-734a-4edc-99f6-a9763cd89e64 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:55.125031 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-4ad3a1b6-734a-4edc-99f6-a9763cd89e64 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:55.132125 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4ad3a1b6-734a-4edc-99f6-a9763cd89e64 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:55.132573 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4ad3a1b6-734a-4edc-99f6-a9763cd89e64 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:55.133353 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4ad3a1b6-734a-4edc-99f6-a9763cd89e64 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:55.133774 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4ad3a1b6-734a-4edc-99f6-a9763cd89e64 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:55.276014 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-4ad3a1b6-734a-4edc-99f6-a9763cd89e64 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:38:55.283857 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-4ad3a1b6-734a-4edc-99f6-a9763cd89e64 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1681 microversion: 2.1 time: 0.166687 Jul 20 08:38:55.284433 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 690/1331] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:38:55 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:38:56.302284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d1276ecc-e93f-4771-8e50-757e9d525bca tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:56.303502 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d1276ecc-e93f-4771-8e50-757e9d525bca tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:56.313997 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d1276ecc-e93f-4771-8e50-757e9d525bca tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:56.314541 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d1276ecc-e93f-4771-8e50-757e9d525bca tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:56.315423 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d1276ecc-e93f-4771-8e50-757e9d525bca tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:56.315931 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d1276ecc-e93f-4771-8e50-757e9d525bca tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:56.599373 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d1276ecc-e93f-4771-8e50-757e9d525bca tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:38:56.609680 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d1276ecc-e93f-4771-8e50-757e9d525bca tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1681 microversion: 2.1 time: 0.311400 Jul 20 08:38:56.610514 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 642/1332] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:38:56 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1681 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:38:57.335014 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-42b1b0bc-b6d1-4527-94ea-2bf58248afeb req-7dbea9e7-b6e4-4f14-b764-170972de4d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c207a53a-b0d9-4d09-8ce1-beecdf160eef", "name": "network-vif-deleted", "tag": "f0b4011c-e1be-4ef1-914b-9e51374f2b5f"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:38:57.345184 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-42b1b0bc-b6d1-4527-94ea-2bf58248afeb req-7dbea9e7-b6e4-4f14-b764-170972de4d23 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:57.345692 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-42b1b0bc-b6d1-4527-94ea-2bf58248afeb req-7dbea9e7-b6e4-4f14-b764-170972de4d23 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:57.359697 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-42b1b0bc-b6d1-4527-94ea-2bf58248afeb req-7dbea9e7-b6e4-4f14-b764-170972de4d23 service nova] Creating event network-vif-deleted:f0b4011c-e1be-4ef1-914b-9e51374f2b5f for instance c207a53a-b0d9-4d09-8ce1-beecdf160eef on hv-cinder-82308 Jul 20 08:38:57.372877 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-42b1b0bc-b6d1-4527-94ea-2bf58248afeb req-7dbea9e7-b6e4-4f14-b764-170972de4d23 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047192 Jul 20 08:38:57.378276 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 691/1333] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:38:57.628396 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-cf177392-3ec7-48ba-abfe-342a02f85092 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:57.629740 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-cf177392-3ec7-48ba-abfe-342a02f85092 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:57.639048 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cf177392-3ec7-48ba-abfe-342a02f85092 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:57.648590 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cf177392-3ec7-48ba-abfe-342a02f85092 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:57.649786 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cf177392-3ec7-48ba-abfe-342a02f85092 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:57.651187 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cf177392-3ec7-48ba-abfe-342a02f85092 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:57.688453 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cf177392-3ec7-48ba-abfe-342a02f85092 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:57.689234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-cf177392-3ec7-48ba-abfe-342a02f85092 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:57.689737 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.objects.instance [None req-cf177392-3ec7-48ba-abfe-342a02f85092 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lazy-loading 'fault' on Instance uuid c207a53a-b0d9-4d09-8ce1-beecdf160eef {{(pid=117829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:38:58.033784 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-cf177392-3ec7-48ba-abfe-342a02f85092 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6c2070c6d2a450c887b8ca6b97c4b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60ee8039b1f4461c996165d5801b91f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:38:58.043605 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-cf177392-3ec7-48ba-abfe-342a02f85092 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 200 len: 1331 microversion: 2.1 time: 0.419167 Jul 20 08:38:58.044193 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 643/1334] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:38:57 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 1331 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:38:59.062775 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-4eed7552-5e34-47ce-b02f-557285c6fa78 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:59.064057 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-4eed7552-5e34-47ce-b02f-557285c6fa78 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:38:59.071351 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4eed7552-5e34-47ce-b02f-557285c6fa78 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:59.072108 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4eed7552-5e34-47ce-b02f-557285c6fa78 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:59.073801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4eed7552-5e34-47ce-b02f-557285c6fa78 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:38:59.075378 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-4eed7552-5e34-47ce-b02f-557285c6fa78 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:38:59.091449 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-4eed7552-5e34-47ce-b02f-557285c6fa78 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] HTTP exception thrown: Instance c207a53a-b0d9-4d09-8ce1-beecdf160eef could not be found. Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-4eed7552-5e34-47ce-b02f-557285c6fa78 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Request method failure captured: Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef HTTP/1.1 Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wixdWG9rc5IFR0aB2pk_ZbXSzHzAQw9OV7xc6ffVi-gC9dtYrya3ESysbvKCfhbC_hvUIb5xnU9fWVg9utseHpLd4EE5IxzuhHoy9DAbH7v7TBBmqEfRBrYIOvZrsS5CsvlsB_ARu1p91yjGC4MVw6_W2whdtfwL_HLJU3zguHAXQ Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:38:59.093093 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:38:59.094941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60ee8039b1f4461c996165d5801b91f1", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:38:59.094941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:38:59.094941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:38:59.094941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:38:59.094941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:38:59.094941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:38:59.094941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:38:59.094941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: e6c2070c6d2a450c887b8ca6b97c4b38 Jul 20 08:38:59.094941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:38:59.094941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:38:59.094941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance c207a53a-b0d9-4d09-8ce1-beecdf160eef could not be found. Jul 20 08:38:59.094941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': 'c207a53a-b0d9-4d09-8ce1-beecdf160eef'} Jul 20 08:38:59.095785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:38:59.095785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:59.095785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:38:59.095785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:38:59.095785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:38:59.095785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:38:59.095785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:38:59.095785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:38:59.095785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:38:59.095785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:38:59.095785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c207a53a-b0d9-4d09-8ce1-beecdf160eef could not be found. Jul 20 08:38:59.095785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:38:59.095785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:38:59.095785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:38:59.095785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:59.095785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:38:59.095785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:38:59.095785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:38:59.095785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:38:59.095785 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:38:59.097130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:38:59.097130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:38:59.097130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:38:59.097130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:38:59.097130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:38:59.097130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:38:59.097130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:38:59.097130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c207a53a-b0d9-4d09-8ce1-beecdf160eef could not be found. Jul 20 08:38:59.097130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:38:59.097130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:38:59.097130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:38:59.097130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:38:59.097130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:38:59.097130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:38:59.097130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:38:59.097130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:38:59.097130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c207a53a-b0d9-4d09-8ce1-beecdf160eef could not be found. Jul 20 08:38:59.097130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:38:59.098271 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-4eed7552-5e34-47ce-b02f-557285c6fa78 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Returning 404 to user: Instance c207a53a-b0d9-4d09-8ce1-beecdf160eef could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:38:59.098271 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-4eed7552-5e34-47ce-b02f-557285c6fa78 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 404 len: 111 microversion: 2.1 time: 0.036631 Jul 20 08:38:59.098271 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 692/1335] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:38:59 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:38:59.103353 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d343c2d1-9fd1-423d-bbb0-610bc6e01537 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '.version_select at 0x7fe39a96c5e0>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:38:59.126177 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d343c2d1-9fd1-423d-bbb0-610bc6e01537 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1861541787" status: 202 len: 0 microversion: 2.1 time: 0.026520 Jul 20 08:38:59.126910 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 644/1336] 10.222.0.64 () {58 vars in 1220 bytes} [Wed Jul 20 08:38:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1861541787 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:39:01.060081 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-553486eb-7678-4e3e-bed9-cece9bf139e2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:39:01.061266 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-553486eb-7678-4e3e-bed9-cece9bf139e2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:39:01.070843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-553486eb-7678-4e3e-bed9-cece9bf139e2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:01.071297 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-553486eb-7678-4e3e-bed9-cece9bf139e2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:01.072338 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-553486eb-7678-4e3e-bed9-cece9bf139e2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:01.072926 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-553486eb-7678-4e3e-bed9-cece9bf139e2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:01.089002 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-553486eb-7678-4e3e-bed9-cece9bf139e2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] HTTP exception thrown: Instance c207a53a-b0d9-4d09-8ce1-beecdf160eef could not be found. Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-553486eb-7678-4e3e-bed9-cece9bf139e2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Request method failure captured: Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: DELETE /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef HTTP/1.1 Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wixdWG9rc5IFR0aB2pk_ZbXSzHzAQw9OV7xc6ffVi-gC9dtYrya3ESysbvKCfhbC_hvUIb5xnU9fWVg9utseHpLd4EE5IxzuhHoy9DAbH7v7TBBmqEfRBrYIOvZrsS5CsvlsB_ARu1p91yjGC4MVw6_W2whdtfwL_HLJU3zguHAXQ Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:39:01.090560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:39:01.092340 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60ee8039b1f4461c996165d5801b91f1", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:39:01.092340 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:01.092340 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:39:01.092340 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:01.092340 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:39:01.092340 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:39:01.092340 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:39:01.092340 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: e6c2070c6d2a450c887b8ca6b97c4b38 Jul 20 08:39:01.092340 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:39:01.092340 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:39:01.092340 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance c207a53a-b0d9-4d09-8ce1-beecdf160eef could not be found. Jul 20 08:39:01.092340 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': 'c207a53a-b0d9-4d09-8ce1-beecdf160eef'} Jul 20 08:39:01.093306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:39:01.093306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:01.093306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:39:01.093306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:39:01.093306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:39:01.093306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:39:01.093306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:39:01.093306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:39:01.093306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:39:01.093306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:39:01.093306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c207a53a-b0d9-4d09-8ce1-beecdf160eef could not be found. Jul 20 08:39:01.093306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:39:01.093306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:39:01.093306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:39:01.093306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:01.093306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:39:01.093306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:39:01.093306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:39:01.093306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:39:01.093306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:39:01.094940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:39:01.094940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 08:39:01.094940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 08:39:01.094940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 08:39:01.094940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 08:39:01.094940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:39:01.094940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:39:01.094940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:39:01.094940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:39:01.094940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c207a53a-b0d9-4d09-8ce1-beecdf160eef could not be found. Jul 20 08:39:01.094940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:39:01.094940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:39:01.094940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:39:01.094940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:01.094940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:39:01.094940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:39:01.094940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:39:01.094940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:39:01.094940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c207a53a-b0d9-4d09-8ce1-beecdf160eef could not be found. Jul 20 08:39:01.094940 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:39:01.096561 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-553486eb-7678-4e3e-bed9-cece9bf139e2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Returning 404 to user: Instance c207a53a-b0d9-4d09-8ce1-beecdf160eef could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:39:01.096561 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-553486eb-7678-4e3e-bed9-cece9bf139e2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 404 len: 111 microversion: 2.1 time: 0.036064 Jul 20 08:39:01.096561 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 693/1337] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:39:01 2022] DELETE /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:39:01.102593 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3a00df03-1d4a-4b47-b1ab-f7874ada0ca2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:39:01.103426 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-3a00df03-1d4a-4b47-b1ab-f7874ada0ca2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: c207a53a-b0d9-4d09-8ce1-beecdf160eef] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:39:01.111058 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3a00df03-1d4a-4b47-b1ab-f7874ada0ca2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:01.111506 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3a00df03-1d4a-4b47-b1ab-f7874ada0ca2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:01.112293 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3a00df03-1d4a-4b47-b1ab-f7874ada0ca2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:01.112943 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-3a00df03-1d4a-4b47-b1ab-f7874ada0ca2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:01.130284 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-3a00df03-1d4a-4b47-b1ab-f7874ada0ca2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] HTTP exception thrown: Instance c207a53a-b0d9-4d09-8ce1-beecdf160eef could not be found. Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3a00df03-1d4a-4b47-b1ab-f7874ada0ca2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Request method failure captured: Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef HTTP/1.1 Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17wixdWG9rc5IFR0aB2pk_ZbXSzHzAQw9OV7xc6ffVi-gC9dtYrya3ESysbvKCfhbC_hvUIb5xnU9fWVg9utseHpLd4EE5IxzuhHoy9DAbH7v7TBBmqEfRBrYIOvZrsS5CsvlsB_ARu1p91yjGC4MVw6_W2whdtfwL_HLJU3zguHAXQ Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:39:01.132239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:39:01.133829 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60ee8039b1f4461c996165d5801b91f1", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:39:01.133829 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:01.133829 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:39:01.133829 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:01.133829 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:39:01.133829 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:39:01.133829 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:39:01.133829 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: e6c2070c6d2a450c887b8ca6b97c4b38 Jul 20 08:39:01.133829 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:39:01.133829 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: > Jul 20 08:39:01.133829 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Instance c207a53a-b0d9-4d09-8ce1-beecdf160eef could not be found. Jul 20 08:39:01.133829 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': 'c207a53a-b0d9-4d09-8ce1-beecdf160eef'} Jul 20 08:39:01.134864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:39:01.134864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:01.134864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:39:01.134864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:39:01.134864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:39:01.134864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:39:01.134864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:39:01.134864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:39:01.134864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:39:01.134864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:39:01.134864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c207a53a-b0d9-4d09-8ce1-beecdf160eef could not be found. Jul 20 08:39:01.134864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:39:01.134864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:39:01.134864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:39:01.134864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:01.134864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:39:01.134864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:39:01.134864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:39:01.134864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:39:01.134864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:39:01.136340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:39:01.136340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:39:01.136340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:39:01.136340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:39:01.136340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:39:01.136340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:39:01.136340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:39:01.136340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c207a53a-b0d9-4d09-8ce1-beecdf160eef could not be found. Jul 20 08:39:01.136340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:39:01.136340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:39:01.136340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:39:01.136340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:01.136340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:39:01.136340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:39:01.136340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:39:01.136340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:39:01.136340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c207a53a-b0d9-4d09-8ce1-beecdf160eef could not be found. Jul 20 08:39:01.136340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:39:01.137523 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-3a00df03-1d4a-4b47-b1ab-f7874ada0ca2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Returning 404 to user: Instance c207a53a-b0d9-4d09-8ce1-beecdf160eef could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:39:01.137523 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-3a00df03-1d4a-4b47-b1ab-f7874ada0ca2 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef" status: 404 len: 111 microversion: 2.1 time: 0.036253 Jul 20 08:39:01.137523 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 645/1338] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:39:01 2022] GET /compute/v2.1/servers/c207a53a-b0d9-4d09-8ce1-beecdf160eef => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 08:39:02.321813 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-183e405f-78fc-4da5-8943-30ed2b209df1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:39:02.322439 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-183e405f-78fc-4da5-8943-30ed2b209df1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:39:02.329520 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-183e405f-78fc-4da5-8943-30ed2b209df1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:02.330023 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-183e405f-78fc-4da5-8943-30ed2b209df1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:02.330877 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-183e405f-78fc-4da5-8943-30ed2b209df1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:02.331338 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-183e405f-78fc-4da5-8943-30ed2b209df1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:02.348689 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-183e405f-78fc-4da5-8943-30ed2b209df1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] HTTP exception thrown: Instance b364a329-6312-40e4-b7cf-da7b1dcaca77 could not be found. Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-183e405f-78fc-4da5-8943-30ed2b209df1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Request method failure captured: Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: DELETE /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 HTTP/1.1 Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wixdWG9rc5IFR0aB2pk_ZbXSzHzAQw9OV7xc6ffVi-gC9dtYrya3ESysbvKCfhbC_hvUIb5xnU9fWVg9utseHpLd4EE5IxzuhHoy9DAbH7v7TBBmqEfRBrYIOvZrsS5CsvlsB_ARu1p91yjGC4MVw6_W2whdtfwL_HLJU3zguHAXQ Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:39:02.350356 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:39:02.355128 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60ee8039b1f4461c996165d5801b91f1", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:39:02.355128 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:02.355128 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:39:02.355128 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:02.355128 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:39:02.355128 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:39:02.355128 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:39:02.355128 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: e6c2070c6d2a450c887b8ca6b97c4b38 Jul 20 08:39:02.355128 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:39:02.355128 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:39:02.355128 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance b364a329-6312-40e4-b7cf-da7b1dcaca77 could not be found. Jul 20 08:39:02.355128 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': 'b364a329-6312-40e4-b7cf-da7b1dcaca77'} Jul 20 08:39:02.357758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:39:02.357758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:02.357758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:39:02.357758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:39:02.357758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:39:02.357758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:39:02.357758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:39:02.357758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:39:02.357758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:39:02.357758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:39:02.357758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b364a329-6312-40e4-b7cf-da7b1dcaca77 could not be found. Jul 20 08:39:02.357758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:39:02.357758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:39:02.357758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:39:02.357758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:02.357758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:39:02.357758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:39:02.357758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:39:02.357758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:39:02.357758 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:39:02.360797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:39:02.360797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 08:39:02.360797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 08:39:02.360797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 08:39:02.360797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 08:39:02.360797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:39:02.360797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:39:02.360797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:39:02.360797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:39:02.360797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b364a329-6312-40e4-b7cf-da7b1dcaca77 could not be found. Jul 20 08:39:02.360797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:39:02.360797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:39:02.360797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:39:02.360797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:02.360797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:39:02.360797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:39:02.360797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:39:02.360797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:39:02.360797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b364a329-6312-40e4-b7cf-da7b1dcaca77 could not be found. Jul 20 08:39:02.360797 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:39:02.363551 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-183e405f-78fc-4da5-8943-30ed2b209df1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Returning 404 to user: Instance b364a329-6312-40e4-b7cf-da7b1dcaca77 could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:39:02.363551 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-183e405f-78fc-4da5-8943-30ed2b209df1 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 404 len: 111 microversion: 2.1 time: 0.033963 Jul 20 08:39:02.363551 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 694/1339] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:39:02 2022] DELETE /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:39:02.364002 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5e69998b-bf3b-43ff-a656-e1cded4a84e9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:39:02.364002 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-5e69998b-bf3b-43ff-a656-e1cded4a84e9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: b364a329-6312-40e4-b7cf-da7b1dcaca77] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:39:02.369229 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5e69998b-bf3b-43ff-a656-e1cded4a84e9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:02.369718 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5e69998b-bf3b-43ff-a656-e1cded4a84e9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:02.370777 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5e69998b-bf3b-43ff-a656-e1cded4a84e9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:02.371095 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-5e69998b-bf3b-43ff-a656-e1cded4a84e9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:02.387686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-5e69998b-bf3b-43ff-a656-e1cded4a84e9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] HTTP exception thrown: Instance b364a329-6312-40e4-b7cf-da7b1dcaca77 could not be found. Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5e69998b-bf3b-43ff-a656-e1cded4a84e9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Request method failure captured: Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 HTTP/1.1 Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17wixdWG9rc5IFR0aB2pk_ZbXSzHzAQw9OV7xc6ffVi-gC9dtYrya3ESysbvKCfhbC_hvUIb5xnU9fWVg9utseHpLd4EE5IxzuhHoy9DAbH7v7TBBmqEfRBrYIOvZrsS5CsvlsB_ARu1p91yjGC4MVw6_W2whdtfwL_HLJU3zguHAXQ Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:39:02.389365 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:39:02.391464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60ee8039b1f4461c996165d5801b91f1", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:39:02.391464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:02.391464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:39:02.391464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:02.391464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:39:02.391464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:39:02.391464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:39:02.391464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: e6c2070c6d2a450c887b8ca6b97c4b38 Jul 20 08:39:02.391464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:39:02.391464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: > Jul 20 08:39:02.391464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Instance b364a329-6312-40e4-b7cf-da7b1dcaca77 could not be found. Jul 20 08:39:02.391464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': 'b364a329-6312-40e4-b7cf-da7b1dcaca77'} Jul 20 08:39:02.392763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:39:02.392763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:02.392763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:39:02.392763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:39:02.392763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:39:02.392763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:39:02.392763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:39:02.392763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:39:02.392763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:39:02.392763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:39:02.392763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b364a329-6312-40e4-b7cf-da7b1dcaca77 could not be found. Jul 20 08:39:02.392763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:39:02.392763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:39:02.392763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:39:02.392763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:02.392763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:39:02.392763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:39:02.392763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:39:02.392763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:39:02.392763 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:39:02.394519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:39:02.394519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:39:02.394519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:39:02.394519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:39:02.394519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:39:02.394519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:39:02.394519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:39:02.394519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b364a329-6312-40e4-b7cf-da7b1dcaca77 could not be found. Jul 20 08:39:02.394519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:39:02.394519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:39:02.394519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:39:02.394519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:02.394519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:39:02.394519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:39:02.394519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:39:02.394519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:39:02.394519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b364a329-6312-40e4-b7cf-da7b1dcaca77 could not be found. Jul 20 08:39:02.394519 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:39:02.396706 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-5e69998b-bf3b-43ff-a656-e1cded4a84e9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Returning 404 to user: Instance b364a329-6312-40e4-b7cf-da7b1dcaca77 could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:39:02.396706 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-5e69998b-bf3b-43ff-a656-e1cded4a84e9 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77" status: 404 len: 111 microversion: 2.1 time: 0.033603 Jul 20 08:39:02.396706 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 646/1340] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:39:02 2022] GET /compute/v2.1/servers/b364a329-6312-40e4-b7cf-da7b1dcaca77 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:39:02.400661 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ca5e920e-d8e8-44f3-857a-3d32fbcb6662 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:39:02.401166 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ca5e920e-d8e8-44f3-857a-3d32fbcb6662 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:39:02.407362 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ca5e920e-d8e8-44f3-857a-3d32fbcb6662 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:02.407807 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ca5e920e-d8e8-44f3-857a-3d32fbcb6662 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:02.408594 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ca5e920e-d8e8-44f3-857a-3d32fbcb6662 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:02.409035 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ca5e920e-d8e8-44f3-857a-3d32fbcb6662 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:02.425205 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-ca5e920e-d8e8-44f3-857a-3d32fbcb6662 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] HTTP exception thrown: Instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c could not be found. Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ca5e920e-d8e8-44f3-857a-3d32fbcb6662 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Request method failure captured: Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: DELETE /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c HTTP/1.1 Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wixdWG9rc5IFR0aB2pk_ZbXSzHzAQw9OV7xc6ffVi-gC9dtYrya3ESysbvKCfhbC_hvUIb5xnU9fWVg9utseHpLd4EE5IxzuhHoy9DAbH7v7TBBmqEfRBrYIOvZrsS5CsvlsB_ARu1p91yjGC4MVw6_W2whdtfwL_HLJU3zguHAXQ Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:39:02.426792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:39:02.428480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60ee8039b1f4461c996165d5801b91f1", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:39:02.428480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:02.428480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:39:02.428480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:02.428480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:39:02.428480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:39:02.428480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:39:02.428480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: e6c2070c6d2a450c887b8ca6b97c4b38 Jul 20 08:39:02.428480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:39:02.428480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:39:02.428480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c could not be found. Jul 20 08:39:02.428480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': '28eb9e1d-9ca5-43a1-8330-ae91249f609c'} Jul 20 08:39:02.429941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:39:02.429941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:02.429941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:39:02.429941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:39:02.429941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:39:02.429941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:39:02.429941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:39:02.429941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:39:02.429941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:39:02.429941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:39:02.429941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c could not be found. Jul 20 08:39:02.429941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:39:02.429941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:39:02.429941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:39:02.429941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:02.429941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:39:02.429941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:39:02.429941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:39:02.429941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:39:02.429941 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:39:02.432337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:39:02.432337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 08:39:02.432337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 08:39:02.432337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 08:39:02.432337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 08:39:02.432337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:39:02.432337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:39:02.432337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:39:02.432337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:39:02.432337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c could not be found. Jul 20 08:39:02.432337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:39:02.432337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:39:02.432337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:39:02.432337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:02.432337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:39:02.432337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:39:02.432337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:39:02.432337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:39:02.432337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c could not be found. Jul 20 08:39:02.432337 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:39:02.434446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ca5e920e-d8e8-44f3-857a-3d32fbcb6662 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Returning 404 to user: Instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:39:02.434446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ca5e920e-d8e8-44f3-857a-3d32fbcb6662 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "DELETE /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 404 len: 111 microversion: 2.1 time: 0.031899 Jul 20 08:39:02.434446 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 695/1341] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:39:02 2022] DELETE /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:39:02.437516 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-188e25d2-9ee0-4cd9-989a-48c4aa4b169d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:39:02.438195 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-188e25d2-9ee0-4cd9-989a-48c4aa4b169d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 28eb9e1d-9ca5-43a1-8330-ae91249f609c] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:39:02.445352 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-188e25d2-9ee0-4cd9-989a-48c4aa4b169d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:02.445802 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-188e25d2-9ee0-4cd9-989a-48c4aa4b169d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:02.446601 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-188e25d2-9ee0-4cd9-989a-48c4aa4b169d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:02.447258 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-188e25d2-9ee0-4cd9-989a-48c4aa4b169d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:02.463105 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-188e25d2-9ee0-4cd9-989a-48c4aa4b169d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] HTTP exception thrown: Instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c could not be found. Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-188e25d2-9ee0-4cd9-989a-48c4aa4b169d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Request method failure captured: Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c HTTP/1.1 Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17wixdWG9rc5IFR0aB2pk_ZbXSzHzAQw9OV7xc6ffVi-gC9dtYrya3ESysbvKCfhbC_hvUIb5xnU9fWVg9utseHpLd4EE5IxzuhHoy9DAbH7v7TBBmqEfRBrYIOvZrsS5CsvlsB_ARu1p91yjGC4MVw6_W2whdtfwL_HLJU3zguHAXQ Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:39:02.464864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:39:02.466464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60ee8039b1f4461c996165d5801b91f1", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:39:02.466464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:02.466464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:39:02.466464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:02.466464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:39:02.466464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:39:02.466464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:39:02.466464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: e6c2070c6d2a450c887b8ca6b97c4b38 Jul 20 08:39:02.466464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:39:02.466464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: > Jul 20 08:39:02.466464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c could not be found. Jul 20 08:39:02.466464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': '28eb9e1d-9ca5-43a1-8330-ae91249f609c'} Jul 20 08:39:02.467443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:39:02.467443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:02.467443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:39:02.467443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:39:02.467443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:39:02.467443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:39:02.467443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:39:02.467443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:39:02.467443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:39:02.467443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:39:02.467443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c could not be found. Jul 20 08:39:02.467443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:39:02.467443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:39:02.467443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:39:02.467443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:02.467443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:39:02.467443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:39:02.467443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:39:02.467443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:39:02.467443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:39:02.468781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:39:02.468781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:39:02.468781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:39:02.468781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:39:02.468781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:39:02.468781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:39:02.468781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:39:02.468781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c could not be found. Jul 20 08:39:02.468781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:39:02.468781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:39:02.468781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:39:02.468781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:02.468781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:39:02.468781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:39:02.468781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:39:02.468781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:39:02.468781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c could not be found. Jul 20 08:39:02.468781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:39:02.469871 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-188e25d2-9ee0-4cd9-989a-48c4aa4b169d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Returning 404 to user: Instance 28eb9e1d-9ca5-43a1-8330-ae91249f609c could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:39:02.469871 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-188e25d2-9ee0-4cd9-989a-48c4aa4b169d tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c" status: 404 len: 111 microversion: 2.1 time: 0.032964 Jul 20 08:39:02.470109 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 647/1342] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:39:02 2022] GET /compute/v2.1/servers/28eb9e1d-9ca5-43a1-8330-ae91249f609c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:39:03.642047 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a255cee4-afd3-48d1-ac46-b3146e3d735e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:39:03.642693 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a255cee4-afd3-48d1-ac46-b3146e3d735e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:39:03.649585 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a255cee4-afd3-48d1-ac46-b3146e3d735e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:03.650190 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a255cee4-afd3-48d1-ac46-b3146e3d735e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:03.651660 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a255cee4-afd3-48d1-ac46-b3146e3d735e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:03.652258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a255cee4-afd3-48d1-ac46-b3146e3d735e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:03.670185 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-a255cee4-afd3-48d1-ac46-b3146e3d735e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] HTTP exception thrown: Instance 659d1d17-9163-4971-9ba1-40f3f20d2650 could not be found. Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a255cee4-afd3-48d1-ac46-b3146e3d735e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Request method failure captured: Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: DELETE /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 HTTP/1.1 Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17wixdWG9rc5IFR0aB2pk_ZbXSzHzAQw9OV7xc6ffVi-gC9dtYrya3ESysbvKCfhbC_hvUIb5xnU9fWVg9utseHpLd4EE5IxzuhHoy9DAbH7v7TBBmqEfRBrYIOvZrsS5CsvlsB_ARu1p91yjGC4MVw6_W2whdtfwL_HLJU3zguHAXQ Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:39:03.671773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:39:03.673451 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60ee8039b1f4461c996165d5801b91f1", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:39:03.673451 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:03.673451 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:39:03.673451 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:03.673451 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:39:03.673451 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:39:03.673451 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:39:03.673451 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: e6c2070c6d2a450c887b8ca6b97c4b38 Jul 20 08:39:03.673451 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:39:03.673451 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:39:03.673451 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance 659d1d17-9163-4971-9ba1-40f3f20d2650 could not be found. Jul 20 08:39:03.673451 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': '659d1d17-9163-4971-9ba1-40f3f20d2650'} Jul 20 08:39:03.677633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:39:03.677633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:03.677633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:39:03.677633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:39:03.677633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:39:03.677633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:39:03.677633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:39:03.677633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:39:03.677633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:39:03.677633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:39:03.677633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 659d1d17-9163-4971-9ba1-40f3f20d2650 could not be found. Jul 20 08:39:03.677633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:39:03.677633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:39:03.677633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:39:03.677633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:03.677633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:39:03.677633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:39:03.677633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:39:03.677633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:39:03.677633 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:39:03.680050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:39:03.680050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 08:39:03.680050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 08:39:03.680050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 08:39:03.680050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 08:39:03.680050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:39:03.680050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:39:03.680050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:39:03.680050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:39:03.680050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 659d1d17-9163-4971-9ba1-40f3f20d2650 could not be found. Jul 20 08:39:03.680050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:39:03.680050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:39:03.680050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:39:03.680050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:03.680050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:39:03.680050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:39:03.680050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:39:03.680050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:39:03.680050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 659d1d17-9163-4971-9ba1-40f3f20d2650 could not be found. Jul 20 08:39:03.680050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:39:03.681318 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a255cee4-afd3-48d1-ac46-b3146e3d735e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Returning 404 to user: Instance 659d1d17-9163-4971-9ba1-40f3f20d2650 could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:39:03.681318 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a255cee4-afd3-48d1-ac46-b3146e3d735e tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "DELETE /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 404 len: 111 microversion: 2.1 time: 0.035638 Jul 20 08:39:03.681318 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 696/1343] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:39:03 2022] DELETE /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:39:03.689877 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6b59c7d5-e49f-4a06-aaf1-bcbfd071aa48 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:39:03.691481 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-6b59c7d5-e49f-4a06-aaf1-bcbfd071aa48 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] [instance: 659d1d17-9163-4971-9ba1-40f3f20d2650] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:39:03.706244 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6b59c7d5-e49f-4a06-aaf1-bcbfd071aa48 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:03.706743 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6b59c7d5-e49f-4a06-aaf1-bcbfd071aa48 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:03.707600 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6b59c7d5-e49f-4a06-aaf1-bcbfd071aa48 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:03.709241 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-6b59c7d5-e49f-4a06-aaf1-bcbfd071aa48 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:03.728604 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-6b59c7d5-e49f-4a06-aaf1-bcbfd071aa48 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] HTTP exception thrown: Instance 659d1d17-9163-4971-9ba1-40f3f20d2650 could not be found. Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6b59c7d5-e49f-4a06-aaf1-bcbfd071aa48 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Request method failure captured: Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 HTTP/1.1 Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17wixdWG9rc5IFR0aB2pk_ZbXSzHzAQw9OV7xc6ffVi-gC9dtYrya3ESysbvKCfhbC_hvUIb5xnU9fWVg9utseHpLd4EE5IxzuhHoy9DAbH7v7TBBmqEfRBrYIOvZrsS5CsvlsB_ARu1p91yjGC4MVw6_W2whdtfwL_HLJU3zguHAXQ Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:39:03.730870 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:39:03.732496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60ee8039b1f4461c996165d5801b91f1", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60ee8039b1f4461c996165d5801b91f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:39:03.732496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:03.732496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: 60ee8039b1f4461c996165d5801b91f1 Jul 20 08:39:03.732496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-843279038 Jul 20 08:39:03.732496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:39:03.732496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:39:03.732496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:39:03.732496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: e6c2070c6d2a450c887b8ca6b97c4b38 Jul 20 08:39:03.732496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-AttachVolumeNegativeTest-843279038-project Jul 20 08:39:03.732496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: > Jul 20 08:39:03.732496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Instance 659d1d17-9163-4971-9ba1-40f3f20d2650 could not be found. Jul 20 08:39:03.732496 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': '659d1d17-9163-4971-9ba1-40f3f20d2650'} Jul 20 08:39:03.733381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:39:03.733381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:03.733381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:39:03.733381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:39:03.733381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:39:03.733381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:39:03.733381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:39:03.733381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:39:03.733381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:39:03.733381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:39:03.733381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 659d1d17-9163-4971-9ba1-40f3f20d2650 could not be found. Jul 20 08:39:03.733381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:39:03.733381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:39:03.733381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:39:03.733381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:03.733381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:39:03.733381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:39:03.733381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:39:03.733381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:39:03.733381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:39:03.734820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:39:03.734820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:39:03.734820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:39:03.734820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:39:03.734820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:39:03.734820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:39:03.734820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:39:03.734820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 659d1d17-9163-4971-9ba1-40f3f20d2650 could not be found. Jul 20 08:39:03.734820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:39:03.734820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:39:03.734820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:39:03.734820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:39:03.734820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:39:03.734820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:39:03.734820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:39:03.734820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:39:03.734820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 659d1d17-9163-4971-9ba1-40f3f20d2650 could not be found. Jul 20 08:39:03.734820 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:39:03.736109 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-6b59c7d5-e49f-4a06-aaf1-bcbfd071aa48 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] Returning 404 to user: Instance 659d1d17-9163-4971-9ba1-40f3f20d2650 could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:39:03.736109 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-6b59c7d5-e49f-4a06-aaf1-bcbfd071aa48 tempest-AttachVolumeNegativeTest-843279038 tempest-AttachVolumeNegativeTest-843279038-project] 10.222.0.64 "GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650" status: 404 len: 111 microversion: 2.1 time: 0.049523 Jul 20 08:39:03.736109 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 648/1344] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:39:03 2022] GET /compute/v2.1/servers/659d1d17-9163-4971-9ba1-40f3f20d2650 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:39:12.186876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 08:39:12.187583 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Wed Jul 20 08:39:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 08:39:24.844712 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 08:39:24.845345 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Wed Jul 20 08:39:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 08:39:30.707852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0e19a9d5-720c-4052-841a-8cac2882ff42 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-800528177", "imageRef": "5d6b971e-8afe-4e4a-b054-20cd61970c65", "flavorRef": "452", "networks": [{"uuid": "81a79de6-5fd5-4905-8d83-7fd26aa203bb"}]}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:39:30.715160 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:39:30.715904 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:39:30.770523 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.network.neutron [None req-0e19a9d5-720c-4052-841a-8cac2882ff42 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] validate_networks() for [('81a79de6-5fd5-4905-8d83-7fd26aa203bb', None, None, None, None, None)] {{(pid=117828) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:39:31.174230 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-0e19a9d5-720c-4052-841a-8cac2882ff42 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Flavor limits 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:39:31.175037 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-0e19a9d5-720c-4052-841a-8cac2882ff42 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Image limits 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:39:31.175918 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-0e19a9d5-720c-4052-841a-8cac2882ff42 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Flavor pref 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:39:31.176954 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-0e19a9d5-720c-4052-841a-8cac2882ff42 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Image pref 0:0:0 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:39:31.177870 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.virt.hardware [None req-0e19a9d5-720c-4052-841a-8cac2882ff42 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:39:31.194439 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0e19a9d5-720c-4052-841a-8cac2882ff42 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:31.195277 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0e19a9d5-720c-4052-841a-8cac2882ff42 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:31.196719 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0e19a9d5-720c-4052-841a-8cac2882ff42 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:31.198252 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0e19a9d5-720c-4052-841a-8cac2882ff42 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:31.218816 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-0e19a9d5-720c-4052-841a-8cac2882ff42 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Getting quotas for project 0be8b8329d994ec59a61a90f29b2b629. Resources: {'cores', 'ram', 'instances'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:39:31.223004 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.quota [None req-0e19a9d5-720c-4052-841a-8cac2882ff42 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Getting quotas for user 75c0c2f20205457cb2bf99ed549b7517 and project 0be8b8329d994ec59a61a90f29b2b629. Resources: {'cores', 'ram', 'instances'} {{(pid=117828) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:39:31.234530 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0e19a9d5-720c-4052-841a-8cac2882ff42 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Going to run 1 instances... {{(pid=117828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:39:31.236893 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0e19a9d5-720c-4052-841a-8cac2882ff42 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: c8c671d7-3413-41f7-a679-3951058e5050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d6b971e-8afe-4e4a-b054-20cd61970c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:39:31.285371 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0e19a9d5-720c-4052-841a-8cac2882ff42 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581661 Jul 20 08:39:31.291052 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 697/1345] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Jul 20 08:39:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 08:39:31.301879 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-24e5a9e8-3d99-4d64-a839-8f2da291fe13 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:39:31.303017 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-24e5a9e8-3d99-4d64-a839-8f2da291fe13 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: c8c671d7-3413-41f7-a679-3951058e5050] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:39:31.305361 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:39:31.306022 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:39:31.402522 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-24e5a9e8-3d99-4d64-a839-8f2da291fe13 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:39:31.414527 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-24e5a9e8-3d99-4d64-a839-8f2da291fe13 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050" status: 200 len: 1218 microversion: 2.1 time: 0.121809 Jul 20 08:39:31.415475 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 649/1346] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:39:31 2022] GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050 => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:39:32.433386 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-486c07c2-80d3-4a16-a87f-2f231e92dd36 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:39:32.434340 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-486c07c2-80d3-4a16-a87f-2f231e92dd36 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: c8c671d7-3413-41f7-a679-3951058e5050] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:39:32.441970 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-486c07c2-80d3-4a16-a87f-2f231e92dd36 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:32.442348 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-486c07c2-80d3-4a16-a87f-2f231e92dd36 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:32.443146 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-486c07c2-80d3-4a16-a87f-2f231e92dd36 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:32.443580 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-486c07c2-80d3-4a16-a87f-2f231e92dd36 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:32.532592 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-486c07c2-80d3-4a16-a87f-2f231e92dd36 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:39:32.541292 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-486c07c2-80d3-4a16-a87f-2f231e92dd36 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050" status: 200 len: 1270 microversion: 2.1 time: 0.113058 Jul 20 08:39:32.542437 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 698/1347] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:39:32 2022] GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050 => generated 1270 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:39:33.561246 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-aeea9397-9401-4015-b546-111972dacf72 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:39:33.562851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-aeea9397-9401-4015-b546-111972dacf72 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: c8c671d7-3413-41f7-a679-3951058e5050] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:39:33.576685 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aeea9397-9401-4015-b546-111972dacf72 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:33.577442 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aeea9397-9401-4015-b546-111972dacf72 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:33.578609 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aeea9397-9401-4015-b546-111972dacf72 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:33.579400 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-aeea9397-9401-4015-b546-111972dacf72 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:33.865864 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-aeea9397-9401-4015-b546-111972dacf72 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:39:33.874813 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-aeea9397-9401-4015-b546-111972dacf72 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050" status: 200 len: 1318 microversion: 2.1 time: 0.318116 Jul 20 08:39:33.875453 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 650/1348] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:39:33 2022] GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:39:34.671679 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-0ef79532-2682-45ea-a498-aea16af5f8f5 req-e35d1d06-bd38-474d-b44f-100a3bbacc8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8c671d7-3413-41f7-a679-3951058e5050", "tag": "6faee15f-3470-4593-bf98-170d13c068e3"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:39:34.683048 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-0ef79532-2682-45ea-a498-aea16af5f8f5 req-e35d1d06-bd38-474d-b44f-100a3bbacc8d service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:34.683494 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-0ef79532-2682-45ea-a498-aea16af5f8f5 req-e35d1d06-bd38-474d-b44f-100a3bbacc8d service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:34.696705 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-0ef79532-2682-45ea-a498-aea16af5f8f5 req-e35d1d06-bd38-474d-b44f-100a3bbacc8d service nova] Creating event network-changed:6faee15f-3470-4593-bf98-170d13c068e3 for instance c8c671d7-3413-41f7-a679-3951058e5050 on hv-cinder-82308 Jul 20 08:39:34.703761 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-0ef79532-2682-45ea-a498-aea16af5f8f5 req-e35d1d06-bd38-474d-b44f-100a3bbacc8d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035803 Jul 20 08:39:34.704752 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 699/1349] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:39:34.899909 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-245a620b-c364-4588-819b-a59224ae8aec tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:39:34.900549 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-245a620b-c364-4588-819b-a59224ae8aec tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: c8c671d7-3413-41f7-a679-3951058e5050] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:39:34.907507 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-245a620b-c364-4588-819b-a59224ae8aec tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:34.907945 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-245a620b-c364-4588-819b-a59224ae8aec tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:34.909197 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-245a620b-c364-4588-819b-a59224ae8aec tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:34.909197 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-245a620b-c364-4588-819b-a59224ae8aec tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:35.153228 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-245a620b-c364-4588-819b-a59224ae8aec tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:39:35.161647 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-245a620b-c364-4588-819b-a59224ae8aec tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050" status: 200 len: 1318 microversion: 2.1 time: 0.265697 Jul 20 08:39:35.162222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 651/1350] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:39:34 2022] GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:39:36.180003 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-875019be-4bb7-462b-8b5e-7f8679537e97 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:39:36.180772 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-875019be-4bb7-462b-8b5e-7f8679537e97 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: c8c671d7-3413-41f7-a679-3951058e5050] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:39:36.188883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-875019be-4bb7-462b-8b5e-7f8679537e97 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:36.189326 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-875019be-4bb7-462b-8b5e-7f8679537e97 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:36.190097 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-875019be-4bb7-462b-8b5e-7f8679537e97 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:36.190521 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-875019be-4bb7-462b-8b5e-7f8679537e97 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:36.333114 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-875019be-4bb7-462b-8b5e-7f8679537e97 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:39:36.341143 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-875019be-4bb7-462b-8b5e-7f8679537e97 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050" status: 200 len: 1318 microversion: 2.1 time: 0.165328 Jul 20 08:39:36.341703 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 700/1351] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:39:36 2022] GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:39:37.363385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-37bfdb69-a0d8-4d4a-9a50-bd221f634534 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:39:37.364027 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-37bfdb69-a0d8-4d4a-9a50-bd221f634534 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: c8c671d7-3413-41f7-a679-3951058e5050] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:39:37.371542 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-37bfdb69-a0d8-4d4a-9a50-bd221f634534 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:37.371985 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-37bfdb69-a0d8-4d4a-9a50-bd221f634534 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:37.372770 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-37bfdb69-a0d8-4d4a-9a50-bd221f634534 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:37.373204 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-37bfdb69-a0d8-4d4a-9a50-bd221f634534 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:37.516442 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-37bfdb69-a0d8-4d4a-9a50-bd221f634534 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:39:37.524060 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-37bfdb69-a0d8-4d4a-9a50-bd221f634534 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050" status: 200 len: 1318 microversion: 2.1 time: 0.164568 Jul 20 08:39:37.524801 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 652/1352] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:39:37 2022] GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:39:38.544281 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f34f30d6-2e4d-4798-9565-fa4df02d11a7 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:39:38.545115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f34f30d6-2e4d-4798-9565-fa4df02d11a7 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: c8c671d7-3413-41f7-a679-3951058e5050] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:39:38.552331 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f34f30d6-2e4d-4798-9565-fa4df02d11a7 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:38.552779 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f34f30d6-2e4d-4798-9565-fa4df02d11a7 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:38.553787 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f34f30d6-2e4d-4798-9565-fa4df02d11a7 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:38.554228 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f34f30d6-2e4d-4798-9565-fa4df02d11a7 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:38.714332 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f34f30d6-2e4d-4798-9565-fa4df02d11a7 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:39:38.724010 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f34f30d6-2e4d-4798-9565-fa4df02d11a7 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050" status: 200 len: 1318 microversion: 2.1 time: 0.186290 Jul 20 08:39:38.724653 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 701/1353] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:39:38 2022] GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:39:39.741952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-63d726c2-ac2b-410f-80d3-eba0c8279f59 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:39:39.742602 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-63d726c2-ac2b-410f-80d3-eba0c8279f59 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: c8c671d7-3413-41f7-a679-3951058e5050] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:39:39.749511 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-63d726c2-ac2b-410f-80d3-eba0c8279f59 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:39.749963 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-63d726c2-ac2b-410f-80d3-eba0c8279f59 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:39.750765 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-63d726c2-ac2b-410f-80d3-eba0c8279f59 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:39.751200 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-63d726c2-ac2b-410f-80d3-eba0c8279f59 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:39.894460 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-63d726c2-ac2b-410f-80d3-eba0c8279f59 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:39:39.904671 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-63d726c2-ac2b-410f-80d3-eba0c8279f59 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050" status: 200 len: 1318 microversion: 2.1 time: 0.166477 Jul 20 08:39:39.905279 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 653/1354] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:39:39 2022] GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:39:40.922342 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-caa60739-6f71-4669-915c-07bc09236331 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:39:40.923007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-caa60739-6f71-4669-915c-07bc09236331 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: c8c671d7-3413-41f7-a679-3951058e5050] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:39:40.929610 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-caa60739-6f71-4669-915c-07bc09236331 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:40.930049 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-caa60739-6f71-4669-915c-07bc09236331 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:40.930842 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-caa60739-6f71-4669-915c-07bc09236331 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:40.931271 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-caa60739-6f71-4669-915c-07bc09236331 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:41.067870 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-caa60739-6f71-4669-915c-07bc09236331 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:39:41.076325 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-caa60739-6f71-4669-915c-07bc09236331 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050" status: 200 len: 1318 microversion: 2.1 time: 0.157805 Jul 20 08:39:41.076903 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 702/1355] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:39:40 2022] GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:39:41.198965 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-2633e0f6-ca82-41fb-a7d2-79fffee21e26 req-a1d44818-e847-4702-94ad-071787158dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8c671d7-3413-41f7-a679-3951058e5050", "name": "network-vif-plugged", "status": "completed", "tag": "6faee15f-3470-4593-bf98-170d13c068e3"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:39:41.207862 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-2633e0f6-ca82-41fb-a7d2-79fffee21e26 req-a1d44818-e847-4702-94ad-071787158dad service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:41.208447 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-2633e0f6-ca82-41fb-a7d2-79fffee21e26 req-a1d44818-e847-4702-94ad-071787158dad service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:41.220352 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-2633e0f6-ca82-41fb-a7d2-79fffee21e26 req-a1d44818-e847-4702-94ad-071787158dad service nova] Creating event network-vif-plugged:6faee15f-3470-4593-bf98-170d13c068e3 for instance c8c671d7-3413-41f7-a679-3951058e5050 on hv-cinder-82308 Jul 20 08:39:41.225376 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-2633e0f6-ca82-41fb-a7d2-79fffee21e26 req-a1d44818-e847-4702-94ad-071787158dad service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030241 Jul 20 08:39:41.226014 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 654/1356] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:39:42.093247 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-6d6616af-5797-4f68-9579-8746989f3d95 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:39:42.093874 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-6d6616af-5797-4f68-9579-8746989f3d95 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: c8c671d7-3413-41f7-a679-3951058e5050] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:39:42.095774 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=2 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:39:42.096416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=6 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:39:42.102606 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6d6616af-5797-4f68-9579-8746989f3d95 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:42.103050 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6d6616af-5797-4f68-9579-8746989f3d95 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:42.104295 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6d6616af-5797-4f68-9579-8746989f3d95 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:42.104732 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-6d6616af-5797-4f68-9579-8746989f3d95 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:42.248477 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-6d6616af-5797-4f68-9579-8746989f3d95 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:39:42.256380 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-6d6616af-5797-4f68-9579-8746989f3d95 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050" status: 200 len: 1318 microversion: 2.1 time: 0.166892 Jul 20 08:39:42.256966 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 703/1357] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:39:42 2022] GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:39:43.270615 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=2 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:39:43.275510 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ffbcdce5-3b96-41a0-837d-5c940d196162 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:39:43.276241 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ffbcdce5-3b96-41a0-837d-5c940d196162 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: c8c671d7-3413-41f7-a679-3951058e5050] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:39:43.282668 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ffbcdce5-3b96-41a0-837d-5c940d196162 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:43.283110 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ffbcdce5-3b96-41a0-837d-5c940d196162 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:43.283868 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ffbcdce5-3b96-41a0-837d-5c940d196162 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:39:43.284371 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ffbcdce5-3b96-41a0-837d-5c940d196162 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:39:43.420795 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ffbcdce5-3b96-41a0-837d-5c940d196162 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:39:43.428459 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ffbcdce5-3b96-41a0-837d-5c940d196162 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050" status: 200 len: 1506 microversion: 2.1 time: 0.158844 Jul 20 08:39:43.429043 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 655/1358] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:39:43 2022] GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:40:13.349560 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a17b2bd4-1a5c-4d16-81df-5d9c43088c9f tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60658884-9b17-4c6a-b4a0-9652eb6427b3", "device": "/dev/sdb"}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:40:13.351264 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a17b2bd4-1a5c-4d16-81df-5d9c43088c9f tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: c8c671d7-3413-41f7-a679-3951058e5050] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:13.356530 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:40:13.357429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=34 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:40:13.367143 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a17b2bd4-1a5c-4d16-81df-5d9c43088c9f tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:13.367372 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a17b2bd4-1a5c-4d16-81df-5d9c43088c9f tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:13.368576 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a17b2bd4-1a5c-4d16-81df-5d9c43088c9f tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:13.369843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a17b2bd4-1a5c-4d16-81df-5d9c43088c9f tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:13.708883 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a17b2bd4-1a5c-4d16-81df-5d9c43088c9f tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "POST /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365445 Jul 20 08:40:13.710140 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 704/1359] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Jul 20 08:40:13 2022] POST /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:40:26.331921 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=2 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:40:26.333239 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:40:26.335930 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-75eb2c59-5f8c-4918-8e13-65be40840eeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:26.336939 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-75eb2c59-5f8c-4918-8e13-65be40840eeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:26.339424 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-90203044-9873-4c24-b84d-8dea08c6bcaf req-24dec61d-716a-483c-ae16-a7badd912ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbb9c5a6-428c-4725-ad79-45132db1c198", "tag": "50598d79-6502-43f4-85f4-da18b9881657"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:40:26.343134 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=16 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:40:26.345152 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=32 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:40:26.352802 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-75eb2c59-5f8c-4918-8e13-65be40840eeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:26.353868 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-75eb2c59-5f8c-4918-8e13-65be40840eeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:26.355528 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-75eb2c59-5f8c-4918-8e13-65be40840eeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:26.355790 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-90203044-9873-4c24-b84d-8dea08c6bcaf req-24dec61d-716a-483c-ae16-a7badd912ca6 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:26.356306 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-90203044-9873-4c24-b84d-8dea08c6bcaf req-24dec61d-716a-483c-ae16-a7badd912ca6 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:26.356507 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-75eb2c59-5f8c-4918-8e13-65be40840eeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:26.373800 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-90203044-9873-4c24-b84d-8dea08c6bcaf req-24dec61d-716a-483c-ae16-a7badd912ca6 service nova] Creating event network-changed:50598d79-6502-43f4-85f4-da18b9881657 for instance fbb9c5a6-428c-4725-ad79-45132db1c198 on hv-cinder-82308 Jul 20 08:40:26.380956 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-90203044-9873-4c24-b84d-8dea08c6bcaf req-24dec61d-716a-483c-ae16-a7badd912ca6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050355 Jul 20 08:40:26.381953 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 705/1360] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:40:26.411274 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-75eb2c59-5f8c-4918-8e13-65be40840eeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Going to try to terminate instance {{(pid=117829) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:40:26.543326 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-75eb2c59-5f8c-4918-8e13-65be40840eeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "DELETE /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 204 len: 0 microversion: 2.1 time: 0.216390 Jul 20 08:40:26.544420 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 656/1361] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:40:26 2022] DELETE /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:40:26.571110 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-de357c25-b409-41cd-9cc6-b23e0ed7980c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:26.572096 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-de357c25-b409-41cd-9cc6-b23e0ed7980c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:26.593884 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-de357c25-b409-41cd-9cc6-b23e0ed7980c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:26.594756 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-de357c25-b409-41cd-9cc6-b23e0ed7980c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:26.596568 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-de357c25-b409-41cd-9cc6-b23e0ed7980c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:26.597417 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-de357c25-b409-41cd-9cc6-b23e0ed7980c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:26.807404 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-de357c25-b409-41cd-9cc6-b23e0ed7980c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:40:26.817755 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-de357c25-b409-41cd-9cc6-b23e0ed7980c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1577 microversion: 2.1 time: 0.265113 Jul 20 08:40:26.818524 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 706/1362] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:26 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1577 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:40:27.838779 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8537089f-352d-4d86-a6d4-5541d53df1a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:27.839434 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8537089f-352d-4d86-a6d4-5541d53df1a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:27.846974 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8537089f-352d-4d86-a6d4-5541d53df1a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:27.847422 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8537089f-352d-4d86-a6d4-5541d53df1a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:27.848203 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8537089f-352d-4d86-a6d4-5541d53df1a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:27.848633 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8537089f-352d-4d86-a6d4-5541d53df1a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:27.998136 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8537089f-352d-4d86-a6d4-5541d53df1a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:40:28.007535 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8537089f-352d-4d86-a6d4-5541d53df1a3 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1577 microversion: 2.1 time: 0.173112 Jul 20 08:40:28.008452 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 657/1363] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:27 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:40:29.029037 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-22f61b94-cc84-443e-838d-4b5f132238e7 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:29.029717 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-22f61b94-cc84-443e-838d-4b5f132238e7 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:29.037983 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-22f61b94-cc84-443e-838d-4b5f132238e7 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:29.038624 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-22f61b94-cc84-443e-838d-4b5f132238e7 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:29.039628 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-22f61b94-cc84-443e-838d-4b5f132238e7 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:29.040175 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-22f61b94-cc84-443e-838d-4b5f132238e7 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:29.196432 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-22f61b94-cc84-443e-838d-4b5f132238e7 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:40:29.205094 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-22f61b94-cc84-443e-838d-4b5f132238e7 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1577 microversion: 2.1 time: 0.181497 Jul 20 08:40:29.205688 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 707/1364] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:29 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:40:30.222138 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-ed1b9b93-dd27-4afd-8d07-982cb6b70cbd tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:30.223027 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-ed1b9b93-dd27-4afd-8d07-982cb6b70cbd tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:30.229765 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ed1b9b93-dd27-4afd-8d07-982cb6b70cbd tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:30.230215 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ed1b9b93-dd27-4afd-8d07-982cb6b70cbd tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:30.231218 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ed1b9b93-dd27-4afd-8d07-982cb6b70cbd tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:30.231472 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-ed1b9b93-dd27-4afd-8d07-982cb6b70cbd tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:30.457942 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-ed1b9b93-dd27-4afd-8d07-982cb6b70cbd tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:40:30.466150 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-ed1b9b93-dd27-4afd-8d07-982cb6b70cbd tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1577 microversion: 2.1 time: 0.248601 Jul 20 08:40:30.466755 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 658/1365] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:30 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1577 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:40:31.485235 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-b605e9b7-289a-4385-8774-d527499b7bc1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:31.485835 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-b605e9b7-289a-4385-8774-d527499b7bc1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:31.492887 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b605e9b7-289a-4385-8774-d527499b7bc1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:31.493333 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b605e9b7-289a-4385-8774-d527499b7bc1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:31.494118 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b605e9b7-289a-4385-8774-d527499b7bc1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:31.494553 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-b605e9b7-289a-4385-8774-d527499b7bc1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:31.647723 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-b605e9b7-289a-4385-8774-d527499b7bc1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:40:31.656889 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-b605e9b7-289a-4385-8774-d527499b7bc1 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1577 microversion: 2.1 time: 0.176597 Jul 20 08:40:31.657714 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 708/1366] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:31 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:40:32.681678 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-82cab7d5-760e-4ab0-9740-9108c0f00bae tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:32.682241 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-82cab7d5-760e-4ab0-9740-9108c0f00bae tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:32.689852 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-82cab7d5-760e-4ab0-9740-9108c0f00bae tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:32.690296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-82cab7d5-760e-4ab0-9740-9108c0f00bae tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:32.691099 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-82cab7d5-760e-4ab0-9740-9108c0f00bae tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:32.691528 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-82cab7d5-760e-4ab0-9740-9108c0f00bae tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:32.834635 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-82cab7d5-760e-4ab0-9740-9108c0f00bae tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:40:32.842545 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-82cab7d5-760e-4ab0-9740-9108c0f00bae tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1577 microversion: 2.1 time: 0.164889 Jul 20 08:40:32.843188 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 659/1367] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:32 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:40:33.860296 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8b2ea5f5-c9e0-4ec4-b343-2ebd6c984607 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:33.860916 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8b2ea5f5-c9e0-4ec4-b343-2ebd6c984607 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:33.867700 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8b2ea5f5-c9e0-4ec4-b343-2ebd6c984607 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:33.868148 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8b2ea5f5-c9e0-4ec4-b343-2ebd6c984607 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:33.868922 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8b2ea5f5-c9e0-4ec4-b343-2ebd6c984607 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:33.869358 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8b2ea5f5-c9e0-4ec4-b343-2ebd6c984607 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:34.021164 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-8b2ea5f5-c9e0-4ec4-b343-2ebd6c984607 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:40:34.028804 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8b2ea5f5-c9e0-4ec4-b343-2ebd6c984607 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1577 microversion: 2.1 time: 0.172625 Jul 20 08:40:34.029374 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 709/1368] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:33 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:40:35.047650 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-b2255fdd-bf2c-4586-bddd-973b3f57ffeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:35.048305 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-b2255fdd-bf2c-4586-bddd-973b3f57ffeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:35.058435 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b2255fdd-bf2c-4586-bddd-973b3f57ffeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:35.058918 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b2255fdd-bf2c-4586-bddd-973b3f57ffeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:35.059572 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b2255fdd-bf2c-4586-bddd-973b3f57ffeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:35.059952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-b2255fdd-bf2c-4586-bddd-973b3f57ffeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:35.063552 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-515a1c28-d348-4c2b-8ffa-ff9ad14eea2c req-3af95bc2-da95-418e-a6d7-be548334f159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbb9c5a6-428c-4725-ad79-45132db1c198", "name": "network-vif-deleted", "tag": "50598d79-6502-43f4-85f4-da18b9881657"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:40:35.075599 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-515a1c28-d348-4c2b-8ffa-ff9ad14eea2c req-3af95bc2-da95-418e-a6d7-be548334f159 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:35.076394 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-515a1c28-d348-4c2b-8ffa-ff9ad14eea2c req-3af95bc2-da95-418e-a6d7-be548334f159 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:35.090505 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-515a1c28-d348-4c2b-8ffa-ff9ad14eea2c req-3af95bc2-da95-418e-a6d7-be548334f159 service nova] Creating event network-vif-deleted:50598d79-6502-43f4-85f4-da18b9881657 for instance fbb9c5a6-428c-4725-ad79-45132db1c198 on hv-cinder-82308 Jul 20 08:40:35.109719 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-515a1c28-d348-4c2b-8ffa-ff9ad14eea2c req-3af95bc2-da95-418e-a6d7-be548334f159 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051152 Jul 20 08:40:35.111276 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 710/1369] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:40:35.144296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-b2255fdd-bf2c-4586-bddd-973b3f57ffeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:40:35.155859 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-b2255fdd-bf2c-4586-bddd-973b3f57ffeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 200 len: 1391 microversion: 2.1 time: 0.113641 Jul 20 08:40:35.157309 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 660/1370] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:35 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 1391 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:40:36.176631 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a6563b15-288c-4d4b-a04f-3332a1210f82 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:36.177538 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a6563b15-288c-4d4b-a04f-3332a1210f82 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: fbb9c5a6-428c-4725-ad79-45132db1c198] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:36.184902 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a6563b15-288c-4d4b-a04f-3332a1210f82 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:36.185349 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a6563b15-288c-4d4b-a04f-3332a1210f82 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:36.186134 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a6563b15-288c-4d4b-a04f-3332a1210f82 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:36.187476 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a6563b15-288c-4d4b-a04f-3332a1210f82 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:36.203780 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-a6563b15-288c-4d4b-a04f-3332a1210f82 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] HTTP exception thrown: Instance fbb9c5a6-428c-4725-ad79-45132db1c198 could not be found. Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a6563b15-288c-4d4b-a04f-3332a1210f82 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Request method failure captured: Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 HTTP/1.1 Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17z4iiKUecsaa6PUNv71kuWWKnBtrgY4k1MibVftI57Wx_w7GteQnOSFDduat6f1v1LHe_RlY3GnBRpk9VUUSyKzAXBS8iql0T3A7Bt39o_xkfdsgRdTBSqpaCyj5lurRI52hdtkLyQ8hWvO6rOg_1wZx6D8Z1n0QS4E_AQKv0kW8Oc Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: fcfc8ebb18c54de29556d0b93593d676 Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-TestVolumeBootPattern-985957797 Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:40:36.205474 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:40:36.207656 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fcfc8ebb18c54de29556d0b93593d676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fcfc8ebb18c54de29556d0b93593d676"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fcfc8ebb18c54de29556d0b93593d676", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fcfc8ebb18c54de29556d0b93593d676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:40:36.207656 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-TestVolumeBootPattern-985957797 Jul 20 08:40:36.207656 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: fcfc8ebb18c54de29556d0b93593d676 Jul 20 08:40:36.207656 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-TestVolumeBootPattern-985957797 Jul 20 08:40:36.207656 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-TestVolumeBootPattern-985957797-project Jul 20 08:40:36.207656 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:40:36.207656 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:40:36.207656 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: 19024dea6ca94745b38158beb08f29fc Jul 20 08:40:36.207656 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-TestVolumeBootPattern-985957797-project Jul 20 08:40:36.207656 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:40:36.207656 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance fbb9c5a6-428c-4725-ad79-45132db1c198 could not be found. Jul 20 08:40:36.207656 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': 'fbb9c5a6-428c-4725-ad79-45132db1c198'} Jul 20 08:40:36.208873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:40:36.208873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:40:36.208873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:40:36.208873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:40:36.208873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:40:36.208873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:40:36.208873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:40:36.208873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:40:36.208873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:40:36.208873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:40:36.208873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbb9c5a6-428c-4725-ad79-45132db1c198 could not be found. Jul 20 08:40:36.208873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:40:36.208873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:40:36.208873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:40:36.208873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:40:36.208873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:40:36.208873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:40:36.208873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:40:36.208873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:40:36.208873 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:40:36.211871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:40:36.211871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:40:36.211871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:40:36.211871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:40:36.211871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:40:36.211871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:40:36.211871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:40:36.211871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbb9c5a6-428c-4725-ad79-45132db1c198 could not be found. Jul 20 08:40:36.211871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:40:36.211871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:40:36.211871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:40:36.211871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:40:36.211871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:40:36.211871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:40:36.211871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:40:36.211871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:40:36.211871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbb9c5a6-428c-4725-ad79-45132db1c198 could not be found. Jul 20 08:40:36.211871 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:40:36.216292 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a6563b15-288c-4d4b-a04f-3332a1210f82 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Returning 404 to user: Instance fbb9c5a6-428c-4725-ad79-45132db1c198 could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:40:36.216292 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a6563b15-288c-4d4b-a04f-3332a1210f82 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198" status: 404 len: 111 microversion: 2.1 time: 0.036489 Jul 20 08:40:36.216292 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 711/1371] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:36 2022] GET /compute/v2.1/servers/fbb9c5a6-428c-4725-ad79-45132db1c198 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:40:43.704559 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-c7be02be-fe29-428b-974f-01d8f48d389a req-423d1629-e698-46ef-aa94-62ae455ce179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e2a5142-59a5-4ff2-94ed-908fe82b5475", "tag": "5f10e926-b78d-48a1-a5ca-b29f3c55dee7"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:40:43.705978 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-68f7748d-27f9-4a34-a91b-a039575530fe tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:43.707369 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-68f7748d-27f9-4a34-a91b-a039575530fe tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:43.716719 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-68f7748d-27f9-4a34-a91b-a039575530fe tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:43.717344 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-68f7748d-27f9-4a34-a91b-a039575530fe tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:43.719344 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-68f7748d-27f9-4a34-a91b-a039575530fe tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:43.720105 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-68f7748d-27f9-4a34-a91b-a039575530fe tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:43.723324 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-c7be02be-fe29-428b-974f-01d8f48d389a req-423d1629-e698-46ef-aa94-62ae455ce179 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:43.724216 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-c7be02be-fe29-428b-974f-01d8f48d389a req-423d1629-e698-46ef-aa94-62ae455ce179 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:43.747066 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-c7be02be-fe29-428b-974f-01d8f48d389a req-423d1629-e698-46ef-aa94-62ae455ce179 service nova] Creating event network-changed:5f10e926-b78d-48a1-a5ca-b29f3c55dee7 for instance 5e2a5142-59a5-4ff2-94ed-908fe82b5475 on hv-cinder-82308 Jul 20 08:40:43.747745 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-68f7748d-27f9-4a34-a91b-a039575530fe tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Going to try to terminate instance {{(pid=117829) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:40:43.754801 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-c7be02be-fe29-428b-974f-01d8f48d389a req-423d1629-e698-46ef-aa94-62ae455ce179 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053748 Jul 20 08:40:43.755730 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 712/1372] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:40:43.841534 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-68f7748d-27f9-4a34-a91b-a039575530fe tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 204 len: 0 microversion: 2.1 time: 0.143118 Jul 20 08:40:43.842135 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 661/1373] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:40:43 2022] DELETE /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:40:43.852450 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f962a54a-669a-428e-bd19-1c528081ed8e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:43.855837 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f962a54a-669a-428e-bd19-1c528081ed8e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:43.863584 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f962a54a-669a-428e-bd19-1c528081ed8e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:43.864034 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f962a54a-669a-428e-bd19-1c528081ed8e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:43.864821 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f962a54a-669a-428e-bd19-1c528081ed8e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:43.865421 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f962a54a-669a-428e-bd19-1c528081ed8e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:44.211001 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f962a54a-669a-428e-bd19-1c528081ed8e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:40:44.218991 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f962a54a-669a-428e-bd19-1c528081ed8e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1576 microversion: 2.1 time: 0.370809 Jul 20 08:40:44.219576 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 713/1374] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:43 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1576 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:40:45.238121 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-fdd4b634-6fed-4338-8fe5-2aff5eba309e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:45.238851 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-fdd4b634-6fed-4338-8fe5-2aff5eba309e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:45.245321 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fdd4b634-6fed-4338-8fe5-2aff5eba309e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:45.245768 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fdd4b634-6fed-4338-8fe5-2aff5eba309e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:45.246532 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fdd4b634-6fed-4338-8fe5-2aff5eba309e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:45.246991 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fdd4b634-6fed-4338-8fe5-2aff5eba309e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:45.434220 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fdd4b634-6fed-4338-8fe5-2aff5eba309e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:40:45.442629 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-fdd4b634-6fed-4338-8fe5-2aff5eba309e tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1576 microversion: 2.1 time: 0.209512 Jul 20 08:40:45.443202 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 662/1375] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:45 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:40:46.459429 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-7d6cc2aa-f61c-4cc3-943c-8a791424383c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:46.460025 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-7d6cc2aa-f61c-4cc3-943c-8a791424383c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:46.466898 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7d6cc2aa-f61c-4cc3-943c-8a791424383c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:46.467346 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7d6cc2aa-f61c-4cc3-943c-8a791424383c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:46.468807 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7d6cc2aa-f61c-4cc3-943c-8a791424383c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:46.469244 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-7d6cc2aa-f61c-4cc3-943c-8a791424383c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:46.602401 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-7d6cc2aa-f61c-4cc3-943c-8a791424383c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:40:46.610095 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-7d6cc2aa-f61c-4cc3-943c-8a791424383c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1576 microversion: 2.1 time: 0.154505 Jul 20 08:40:46.610692 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 714/1376] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:46 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:40:47.627930 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-287942e5-c2b8-436d-b4c5-fe5e6507aaeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:47.628566 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-287942e5-c2b8-436d-b4c5-fe5e6507aaeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:47.635464 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-287942e5-c2b8-436d-b4c5-fe5e6507aaeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:47.635901 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-287942e5-c2b8-436d-b4c5-fe5e6507aaeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:47.636686 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-287942e5-c2b8-436d-b4c5-fe5e6507aaeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:47.637115 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-287942e5-c2b8-436d-b4c5-fe5e6507aaeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:47.835961 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-287942e5-c2b8-436d-b4c5-fe5e6507aaeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:40:47.844858 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-287942e5-c2b8-436d-b4c5-fe5e6507aaeb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1576 microversion: 2.1 time: 0.221277 Jul 20 08:40:47.845449 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 663/1377] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:47 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1576 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:40:48.649622 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-335acbef-16d6-4d80-a57e-80374566751c req-0b03ecda-8189-4b5a-b245-5c5db520cdb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e2a5142-59a5-4ff2-94ed-908fe82b5475", "name": "network-vif-deleted", "tag": "5f10e926-b78d-48a1-a5ca-b29f3c55dee7"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:40:48.659375 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-335acbef-16d6-4d80-a57e-80374566751c req-0b03ecda-8189-4b5a-b245-5c5db520cdb9 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:48.659812 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-335acbef-16d6-4d80-a57e-80374566751c req-0b03ecda-8189-4b5a-b245-5c5db520cdb9 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:48.671588 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-335acbef-16d6-4d80-a57e-80374566751c req-0b03ecda-8189-4b5a-b245-5c5db520cdb9 service nova] Creating event network-vif-deleted:5f10e926-b78d-48a1-a5ca-b29f3c55dee7 for instance 5e2a5142-59a5-4ff2-94ed-908fe82b5475 on hv-cinder-82308 Jul 20 08:40:48.677120 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-335acbef-16d6-4d80-a57e-80374566751c req-0b03ecda-8189-4b5a-b245-5c5db520cdb9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031211 Jul 20 08:40:48.677711 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 715/1378] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:40:48.865791 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-622cf760-8793-47f3-aad4-c193f255c8e9 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:48.866359 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-622cf760-8793-47f3-aad4-c193f255c8e9 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:48.872867 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-622cf760-8793-47f3-aad4-c193f255c8e9 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:48.873314 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-622cf760-8793-47f3-aad4-c193f255c8e9 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:48.874148 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-622cf760-8793-47f3-aad4-c193f255c8e9 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:48.874748 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-622cf760-8793-47f3-aad4-c193f255c8e9 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:48.940530 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-622cf760-8793-47f3-aad4-c193f255c8e9 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:40:48.949413 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-622cf760-8793-47f3-aad4-c193f255c8e9 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1390 microversion: 2.1 time: 0.087506 Jul 20 08:40:48.950005 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 664/1379] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:48 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:40:49.968122 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-08bf8eb7-a61a-48af-b882-754cb0469927 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:49.968868 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-08bf8eb7-a61a-48af-b882-754cb0469927 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:49.975100 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-08bf8eb7-a61a-48af-b882-754cb0469927 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:49.975542 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-08bf8eb7-a61a-48af-b882-754cb0469927 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:49.976311 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-08bf8eb7-a61a-48af-b882-754cb0469927 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:49.976773 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-08bf8eb7-a61a-48af-b882-754cb0469927 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:50.041972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-08bf8eb7-a61a-48af-b882-754cb0469927 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:40:50.050318 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-08bf8eb7-a61a-48af-b882-754cb0469927 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1225 microversion: 2.1 time: 0.087203 Jul 20 08:40:50.050921 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 716/1380] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:49 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:40:51.067109 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-d41ece1b-e35b-415a-b487-4ed7edf6e244 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:51.067715 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-d41ece1b-e35b-415a-b487-4ed7edf6e244 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:51.074205 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d41ece1b-e35b-415a-b487-4ed7edf6e244 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:51.074687 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d41ece1b-e35b-415a-b487-4ed7edf6e244 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:51.075450 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d41ece1b-e35b-415a-b487-4ed7edf6e244 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:51.075984 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-d41ece1b-e35b-415a-b487-4ed7edf6e244 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:51.137744 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-d41ece1b-e35b-415a-b487-4ed7edf6e244 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:40:51.146116 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-d41ece1b-e35b-415a-b487-4ed7edf6e244 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1225 microversion: 2.1 time: 0.082927 Jul 20 08:40:51.146708 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 665/1381] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:51 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:40:52.163022 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-3ece1cf7-2ad7-4811-9f74-745400fe1983 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:52.163627 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-3ece1cf7-2ad7-4811-9f74-745400fe1983 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:52.169857 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ece1cf7-2ad7-4811-9f74-745400fe1983 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:52.170313 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ece1cf7-2ad7-4811-9f74-745400fe1983 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:52.171894 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ece1cf7-2ad7-4811-9f74-745400fe1983 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:52.172521 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-3ece1cf7-2ad7-4811-9f74-745400fe1983 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:52.236671 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-3ece1cf7-2ad7-4811-9f74-745400fe1983 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:40:52.244399 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-3ece1cf7-2ad7-4811-9f74-745400fe1983 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1225 microversion: 2.1 time: 0.085269 Jul 20 08:40:52.244973 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 717/1382] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:52 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:40:53.261875 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-0dc1c563-8034-4c23-b78c-e90cb08929fb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:53.263150 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-0dc1c563-8034-4c23-b78c-e90cb08929fb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:53.270801 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0dc1c563-8034-4c23-b78c-e90cb08929fb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:53.271250 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0dc1c563-8034-4c23-b78c-e90cb08929fb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:53.272034 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0dc1c563-8034-4c23-b78c-e90cb08929fb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:53.272503 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-0dc1c563-8034-4c23-b78c-e90cb08929fb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:53.341393 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-0dc1c563-8034-4c23-b78c-e90cb08929fb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19024dea6ca94745b38158beb08f29fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfc8ebb18c54de29556d0b93593d676', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:40:53.351014 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-0dc1c563-8034-4c23-b78c-e90cb08929fb tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 200 len: 1225 microversion: 2.1 time: 0.093533 Jul 20 08:40:53.351932 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 666/1383] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:53 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:40:54.368638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-601d2bdd-904b-44bd-b46f-56bee94af13c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:54.369221 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-601d2bdd-904b-44bd-b46f-56bee94af13c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 5e2a5142-59a5-4ff2-94ed-908fe82b5475] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:54.377081 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-601d2bdd-904b-44bd-b46f-56bee94af13c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:54.377579 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-601d2bdd-904b-44bd-b46f-56bee94af13c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:54.378369 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-601d2bdd-904b-44bd-b46f-56bee94af13c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:54.378852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-601d2bdd-904b-44bd-b46f-56bee94af13c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:54.396647 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-601d2bdd-904b-44bd-b46f-56bee94af13c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] HTTP exception thrown: Instance 5e2a5142-59a5-4ff2-94ed-908fe82b5475 could not be found. Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-601d2bdd-904b-44bd-b46f-56bee94af13c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Request method failure captured: Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 HTTP/1.1 Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17z4iiKUecsaa6PUNv71kuWWKnBtrgY4k1MibVftI57Wx_w7GteQnOSFDduat6f1v1LHe_RlY3GnBRpk9VUUSyKzAXBS8iql0T3A7Bt39o_xkfdsgRdTBSqpaCyj5lurRI52hdtkLyQ8hWvO6rOg_1wZx6D8Z1n0QS4E_AQKv0kW8Oc Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: fcfc8ebb18c54de29556d0b93593d676 Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-TestVolumeBootPattern-985957797 Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:40:54.398615 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:40:54.400151 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fcfc8ebb18c54de29556d0b93593d676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fcfc8ebb18c54de29556d0b93593d676"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fcfc8ebb18c54de29556d0b93593d676", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fcfc8ebb18c54de29556d0b93593d676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:40:54.400151 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-TestVolumeBootPattern-985957797 Jul 20 08:40:54.400151 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: fcfc8ebb18c54de29556d0b93593d676 Jul 20 08:40:54.400151 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-TestVolumeBootPattern-985957797 Jul 20 08:40:54.400151 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-TestVolumeBootPattern-985957797-project Jul 20 08:40:54.400151 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:40:54.400151 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:40:54.400151 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: 19024dea6ca94745b38158beb08f29fc Jul 20 08:40:54.400151 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-TestVolumeBootPattern-985957797-project Jul 20 08:40:54.400151 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:40:54.400151 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance 5e2a5142-59a5-4ff2-94ed-908fe82b5475 could not be found. Jul 20 08:40:54.400151 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': '5e2a5142-59a5-4ff2-94ed-908fe82b5475'} Jul 20 08:40:54.400972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:40:54.400972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:40:54.400972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:40:54.400972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:40:54.400972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:40:54.400972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:40:54.400972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:40:54.400972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:40:54.400972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:40:54.400972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:40:54.400972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e2a5142-59a5-4ff2-94ed-908fe82b5475 could not be found. Jul 20 08:40:54.400972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:40:54.400972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:40:54.400972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:40:54.400972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:40:54.400972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:40:54.400972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:40:54.400972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:40:54.400972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:40:54.400972 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:40:54.402493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:40:54.402493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:40:54.402493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:40:54.402493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:40:54.402493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:40:54.402493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:40:54.402493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:40:54.402493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e2a5142-59a5-4ff2-94ed-908fe82b5475 could not be found. Jul 20 08:40:54.402493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:40:54.402493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:40:54.402493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:40:54.402493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:40:54.402493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:40:54.402493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:40:54.402493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:40:54.402493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:40:54.402493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e2a5142-59a5-4ff2-94ed-908fe82b5475 could not be found. Jul 20 08:40:54.402493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:40:54.403877 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-601d2bdd-904b-44bd-b46f-56bee94af13c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Returning 404 to user: Instance 5e2a5142-59a5-4ff2-94ed-908fe82b5475 could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:40:54.403877 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-601d2bdd-904b-44bd-b46f-56bee94af13c tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475" status: 404 len: 111 microversion: 2.1 time: 0.035336 Jul 20 08:40:54.403877 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 718/1384] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:54 2022] GET /compute/v2.1/servers/5e2a5142-59a5-4ff2-94ed-908fe82b5475 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:40:54.890711 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-fa4dbea2-71be-4250-997b-b44957525498 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:54.891906 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-fa4dbea2-71be-4250-997b-b44957525498 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:54.898443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa4dbea2-71be-4250-997b-b44957525498 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:54.898917 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa4dbea2-71be-4250-997b-b44957525498 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:54.899694 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa4dbea2-71be-4250-997b-b44957525498 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:54.900121 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fa4dbea2-71be-4250-997b-b44957525498 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:54.915524 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-fa4dbea2-71be-4250-997b-b44957525498 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] HTTP exception thrown: Instance 15050cb9-f79e-4546-b875-1b4e338312fa could not be found. Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-fa4dbea2-71be-4250-997b-b44957525498 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Request method failure captured: Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: DELETE /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa HTTP/1.1 Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi17z4iiKUecsaa6PUNv71kuWWKnBtrgY4k1MibVftI57Wx_w7GteQnOSFDduat6f1v1LHe_RlY3GnBRpk9VUUSyKzAXBS8iql0T3A7Bt39o_xkfdsgRdTBSqpaCyj5lurRI52hdtkLyQ8hWvO6rOg_1wZx6D8Z1n0QS4E_AQKv0kW8Oc Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: fcfc8ebb18c54de29556d0b93593d676 Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-TestVolumeBootPattern-985957797 Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:40:54.917222 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:40:54.919952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fcfc8ebb18c54de29556d0b93593d676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fcfc8ebb18c54de29556d0b93593d676"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fcfc8ebb18c54de29556d0b93593d676", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fcfc8ebb18c54de29556d0b93593d676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:40:54.919952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-TestVolumeBootPattern-985957797 Jul 20 08:40:54.919952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: fcfc8ebb18c54de29556d0b93593d676 Jul 20 08:40:54.919952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-TestVolumeBootPattern-985957797 Jul 20 08:40:54.919952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-TestVolumeBootPattern-985957797-project Jul 20 08:40:54.919952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:40:54.919952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:40:54.919952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: 19024dea6ca94745b38158beb08f29fc Jul 20 08:40:54.919952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-TestVolumeBootPattern-985957797-project Jul 20 08:40:54.919952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: > Jul 20 08:40:54.919952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Instance 15050cb9-f79e-4546-b875-1b4e338312fa could not be found. Jul 20 08:40:54.919952 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': '15050cb9-f79e-4546-b875-1b4e338312fa'} Jul 20 08:40:54.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:40:54.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:40:54.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:40:54.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:40:54.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:40:54.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:40:54.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:40:54.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:40:54.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:40:54.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:40:54.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15050cb9-f79e-4546-b875-1b4e338312fa could not be found. Jul 20 08:40:54.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:40:54.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:40:54.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:40:54.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:40:54.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:40:54.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:40:54.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:40:54.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:40:54.921951 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:40:54.924397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:40:54.924397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 08:40:54.924397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 08:40:54.924397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 08:40:54.924397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 08:40:54.924397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:40:54.924397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:40:54.924397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:40:54.924397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:40:54.924397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15050cb9-f79e-4546-b875-1b4e338312fa could not be found. Jul 20 08:40:54.924397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:40:54.924397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:40:54.924397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:40:54.924397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:40:54.924397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:40:54.924397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:40:54.924397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:40:54.924397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:40:54.924397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15050cb9-f79e-4546-b875-1b4e338312fa could not be found. Jul 20 08:40:54.924397 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:40:54.926899 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-fa4dbea2-71be-4250-997b-b44957525498 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Returning 404 to user: Instance 15050cb9-f79e-4546-b875-1b4e338312fa could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:40:54.926899 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-fa4dbea2-71be-4250-997b-b44957525498 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "DELETE /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 404 len: 111 microversion: 2.1 time: 0.031932 Jul 20 08:40:54.926899 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 667/1385] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:40:54 2022] DELETE /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 08:40:54.928413 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ae89f462-0ef1-4a1c-9470-00b7e4e7bd41 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:54.929023 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-ae89f462-0ef1-4a1c-9470-00b7e4e7bd41 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] [instance: 15050cb9-f79e-4546-b875-1b4e338312fa] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:54.935488 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ae89f462-0ef1-4a1c-9470-00b7e4e7bd41 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:54.935933 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ae89f462-0ef1-4a1c-9470-00b7e4e7bd41 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:54.936717 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ae89f462-0ef1-4a1c-9470-00b7e4e7bd41 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:54.937143 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-ae89f462-0ef1-4a1c-9470-00b7e4e7bd41 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:54.951868 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-ae89f462-0ef1-4a1c-9470-00b7e4e7bd41 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] HTTP exception thrown: Instance 15050cb9-f79e-4546-b875-1b4e338312fa could not be found. Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ae89f462-0ef1-4a1c-9470-00b7e4e7bd41 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Request method failure captured: Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa HTTP/1.1 Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi17z4iiKUecsaa6PUNv71kuWWKnBtrgY4k1MibVftI57Wx_w7GteQnOSFDduat6f1v1LHe_RlY3GnBRpk9VUUSyKzAXBS8iql0T3A7Bt39o_xkfdsgRdTBSqpaCyj5lurRI52hdtkLyQ8hWvO6rOg_1wZx6D8Z1n0QS4E_AQKv0kW8Oc Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: fcfc8ebb18c54de29556d0b93593d676 Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-TestVolumeBootPattern-985957797 Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:40:54.953416 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:40:54.956015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fcfc8ebb18c54de29556d0b93593d676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/fcfc8ebb18c54de29556d0b93593d676"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_fcfc8ebb18c54de29556d0b93593d676", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/fcfc8ebb18c54de29556d0b93593d676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:40:54.956015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-TestVolumeBootPattern-985957797 Jul 20 08:40:54.956015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: fcfc8ebb18c54de29556d0b93593d676 Jul 20 08:40:54.956015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-TestVolumeBootPattern-985957797 Jul 20 08:40:54.956015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-TestVolumeBootPattern-985957797-project Jul 20 08:40:54.956015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:40:54.956015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:40:54.956015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: 19024dea6ca94745b38158beb08f29fc Jul 20 08:40:54.956015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-TestVolumeBootPattern-985957797-project Jul 20 08:40:54.956015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:40:54.956015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance 15050cb9-f79e-4546-b875-1b4e338312fa could not be found. Jul 20 08:40:54.956015 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': '15050cb9-f79e-4546-b875-1b4e338312fa'} Jul 20 08:40:54.957480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:40:54.957480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:40:54.957480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:40:54.957480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:40:54.957480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:40:54.957480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:40:54.957480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:40:54.957480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:40:54.957480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:40:54.957480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:40:54.957480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15050cb9-f79e-4546-b875-1b4e338312fa could not be found. Jul 20 08:40:54.957480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:40:54.957480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:40:54.957480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:40:54.957480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:40:54.957480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:40:54.957480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:40:54.957480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:40:54.957480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:40:54.957480 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:40:54.960258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:40:54.960258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:40:54.960258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:40:54.960258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:40:54.960258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:40:54.960258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:40:54.960258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:40:54.960258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15050cb9-f79e-4546-b875-1b4e338312fa could not be found. Jul 20 08:40:54.960258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:40:54.960258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:40:54.960258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:40:54.960258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:40:54.960258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:40:54.960258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:40:54.960258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:40:54.960258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:40:54.960258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15050cb9-f79e-4546-b875-1b4e338312fa could not be found. Jul 20 08:40:54.960258 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:40:54.962805 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-ae89f462-0ef1-4a1c-9470-00b7e4e7bd41 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Returning 404 to user: Instance 15050cb9-f79e-4546-b875-1b4e338312fa could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:40:54.962805 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-ae89f462-0ef1-4a1c-9470-00b7e4e7bd41 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa" status: 404 len: 111 microversion: 2.1 time: 0.030229 Jul 20 08:40:54.962805 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 719/1386] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:54 2022] GET /compute/v2.1/servers/15050cb9-f79e-4546-b875-1b4e338312fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 08:40:56.268587 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-dda486f8-33b6-4717-ad06-c2f9c42a4015 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] Calling method '.version_select at 0x7fe39a033940>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:56.290738 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-dda486f8-33b6-4717-ad06-c2f9c42a4015 tempest-TestVolumeBootPattern-985957797 tempest-TestVolumeBootPattern-985957797-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-626472504" status: 202 len: 0 microversion: 2.1 time: 0.026989 Jul 20 08:40:56.291647 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 668/1387] 10.222.0.64 () {58 vars in 1259 bytes} [Wed Jul 20 08:40:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-626472504 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:40:56.712657 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-765d2c34-320b-400f-a988-a4ec98fb5c3f tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:56.713202 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-765d2c34-320b-400f-a988-a4ec98fb5c3f tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: c8c671d7-3413-41f7-a679-3951058e5050] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:56.716484 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=31 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:40:56.723153 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-765d2c34-320b-400f-a988-a4ec98fb5c3f tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:56.723595 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-765d2c34-320b-400f-a988-a4ec98fb5c3f tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:56.724364 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-765d2c34-320b-400f-a988-a4ec98fb5c3f tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:56.724792 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-765d2c34-320b-400f-a988-a4ec98fb5c3f tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:56.739967 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=63 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:40:56.821996 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.objects.instance [None req-765d2c34-320b-400f-a988-a4ec98fb5c3f tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lazy-loading 'services' on Instance uuid c8c671d7-3413-41f7-a679-3951058e5050 {{(pid=117828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:40:56.898982 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-765d2c34-320b-400f-a988-a4ec98fb5c3f tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050/os-volume_attachments/60658884-9b17-4c6a-b4a0-9652eb6427b3" status: 202 len: 0 microversion: 2.1 time: 0.189795 Jul 20 08:40:56.899852 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 720/1388] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Jul 20 08:40:56 2022] DELETE /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050/os-volume_attachments/60658884-9b17-4c6a-b4a0-9652eb6427b3 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:40:58.034184 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-c7da4b2e-d952-4099-88f4-291736327188 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:58.034873 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c7da4b2e-d952-4099-88f4-291736327188 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: c8c671d7-3413-41f7-a679-3951058e5050] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:58.037388 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:40:58.048889 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c7da4b2e-d952-4099-88f4-291736327188 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:58.049352 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c7da4b2e-d952-4099-88f4-291736327188 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:58.050140 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c7da4b2e-d952-4099-88f4-291736327188 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:58.051224 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-c7da4b2e-d952-4099-88f4-291736327188 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:58.057013 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:40:58.081161 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-c7da4b2e-d952-4099-88f4-291736327188 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: c8c671d7-3413-41f7-a679-3951058e5050] Going to try to terminate instance {{(pid=117829) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:40:58.171494 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-c7da4b2e-d952-4099-88f4-291736327188 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050" status: 204 len: 0 microversion: 2.1 time: 0.140326 Jul 20 08:40:58.171982 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 669/1389] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:40:58 2022] DELETE /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:40:58.188187 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f6b74f99-0599-4f4f-9127-e8becb69f236 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:58.189130 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f6b74f99-0599-4f4f-9127-e8becb69f236 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: c8c671d7-3413-41f7-a679-3951058e5050] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:58.200090 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f6b74f99-0599-4f4f-9127-e8becb69f236 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:58.200601 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f6b74f99-0599-4f4f-9127-e8becb69f236 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:58.201552 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f6b74f99-0599-4f4f-9127-e8becb69f236 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:58.202765 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f6b74f99-0599-4f4f-9127-e8becb69f236 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:58.395865 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f6b74f99-0599-4f4f-9127-e8becb69f236 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:40:58.406004 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f6b74f99-0599-4f4f-9127-e8becb69f236 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050" status: 200 len: 1512 microversion: 2.1 time: 0.227788 Jul 20 08:40:58.406734 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 721/1390] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:58 2022] GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050 => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:40:59.424381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-770ae82a-137b-410b-b462-286d2213790c tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:40:59.425087 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-770ae82a-137b-410b-b462-286d2213790c tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: c8c671d7-3413-41f7-a679-3951058e5050] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:40:59.431858 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-770ae82a-137b-410b-b462-286d2213790c tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:59.432191 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-770ae82a-137b-410b-b462-286d2213790c tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:59.432961 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-770ae82a-137b-410b-b462-286d2213790c tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:40:59.433392 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-770ae82a-137b-410b-b462-286d2213790c tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:40:59.625586 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-770ae82a-137b-410b-b462-286d2213790c tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:40:59.633929 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-770ae82a-137b-410b-b462-286d2213790c tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050" status: 200 len: 1512 microversion: 2.1 time: 0.213909 Jul 20 08:40:59.634866 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 670/1391] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:40:59 2022] GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050 => generated 1512 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:41:00.652926 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-929157dc-352b-4359-a1d6-3f1fae7029f5 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:41:00.653687 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-929157dc-352b-4359-a1d6-3f1fae7029f5 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: c8c671d7-3413-41f7-a679-3951058e5050] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:41:00.660455 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-929157dc-352b-4359-a1d6-3f1fae7029f5 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:00.660900 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-929157dc-352b-4359-a1d6-3f1fae7029f5 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:00.661706 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-929157dc-352b-4359-a1d6-3f1fae7029f5 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:00.662137 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-929157dc-352b-4359-a1d6-3f1fae7029f5 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:00.804046 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-929157dc-352b-4359-a1d6-3f1fae7029f5 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:41:00.814246 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-929157dc-352b-4359-a1d6-3f1fae7029f5 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050" status: 200 len: 1512 microversion: 2.1 time: 0.165279 Jul 20 08:41:00.814878 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 722/1392] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:41:00 2022] GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:41:01.087757 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-d0edae59-8737-49a3-a372-3e6252c4b013 req-234660af-35c4-4bd8-84fe-9226115f5196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8c671d7-3413-41f7-a679-3951058e5050", "name": "network-vif-deleted", "tag": "6faee15f-3470-4593-bf98-170d13c068e3"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:41:01.098523 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-d0edae59-8737-49a3-a372-3e6252c4b013 req-234660af-35c4-4bd8-84fe-9226115f5196 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:01.099086 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-d0edae59-8737-49a3-a372-3e6252c4b013 req-234660af-35c4-4bd8-84fe-9226115f5196 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:01.123236 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-d0edae59-8737-49a3-a372-3e6252c4b013 req-234660af-35c4-4bd8-84fe-9226115f5196 service nova] Creating event network-vif-deleted:6faee15f-3470-4593-bf98-170d13c068e3 for instance c8c671d7-3413-41f7-a679-3951058e5050 on hv-cinder-82308 Jul 20 08:41:01.128360 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-d0edae59-8737-49a3-a372-3e6252c4b013 req-234660af-35c4-4bd8-84fe-9226115f5196 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044343 Jul 20 08:41:01.129039 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 671/1393] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:41:01.833362 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8aac498c-f628-44ca-bb0e-dbf93608598d tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:41:01.834035 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-8aac498c-f628-44ca-bb0e-dbf93608598d tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: c8c671d7-3413-41f7-a679-3951058e5050] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:41:01.840753 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8aac498c-f628-44ca-bb0e-dbf93608598d tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:01.841197 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8aac498c-f628-44ca-bb0e-dbf93608598d tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:01.841962 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8aac498c-f628-44ca-bb0e-dbf93608598d tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:01.842430 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-8aac498c-f628-44ca-bb0e-dbf93608598d tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:01.856620 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.wsgi [None req-8aac498c-f628-44ca-bb0e-dbf93608598d tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] HTTP exception thrown: Instance c8c671d7-3413-41f7-a679-3951058e5050 could not be found. Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8aac498c-f628-44ca-bb0e-dbf93608598d tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Request method failure captured: Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: request: GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050 HTTP/1.1 Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept: application/json Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Accept-Encoding: identity Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Connection: close Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Length: 0 Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Content-Type: application/json Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Host: 10.222.0.64 Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Openstack-System-Scope: None Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: User-Agent: python-urllib3/1.26.9 Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Auth-Token: gAAAAABi179BhOjmy7lnU_yb5C_UxIMq5j4u2xVPXF1bgLfOFjnjj37ILrBaFOBu8UC7FbjGkWO3Jux4gDfIXwujpmUh85AOeoBANAHxbr8MyzD8CR76l0ZP4cbtKwMQ4dOLOhOS5gbwWIXyg8rAZ-i355JoGvABmk1Ahqp8eJfEJGqcJtUcJHU Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Id: None Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Domain-Name: None Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Identity-Status: Confirmed Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Is-Admin-Project: True Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Id: default Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Domain-Name: Default Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Id: 0be8b8329d994ec59a61a90f29b2b629 Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1824569512 Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Role: reader,member Jul 20 08:41:01.858377 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Roles: reader,member Jul 20 08:41:01.860469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0be8b8329d994ec59a61a90f29b2b629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0be8b8329d994ec59a61a90f29b2b629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0be8b8329d994ec59a61a90f29b2b629", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0be8b8329d994ec59a61a90f29b2b629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:41:01.860469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant: tempest-VolumesSnapshotTestJSON-1824569512 Jul 20 08:41:01.860469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Id: 0be8b8329d994ec59a61a90f29b2b629 Jul 20 08:41:01.860469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1824569512 Jul 20 08:41:01.860469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User: tempest-VolumesSnapshotTestJSON-1824569512-project Jul 20 08:41:01.860469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Id: default Jul 20 08:41:01.860469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Domain-Name: Default Jul 20 08:41:01.860469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Id: 75c0c2f20205457cb2bf99ed549b7517 Jul 20 08:41:01.860469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: X-User-Name: tempest-VolumesSnapshotTestJSON-1824569512-project Jul 20 08:41:01.860469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: method: > Jul 20 08:41:01.860469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: exception: Instance c8c671d7-3413-41f7-a679-3951058e5050 could not be found. Jul 20 08:41:01.860469 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: action_args: {'id': 'c8c671d7-3413-41f7-a679-3951058e5050'} Jul 20 08:41:01.861473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:41:01.861473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:41:01.861473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:41:01.861473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:41:01.861473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:41:01.861473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:41:01.861473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:41:01.861473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:41:01.861473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:41:01.861473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:41:01.861473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8c671d7-3413-41f7-a679-3951058e5050 could not be found. Jul 20 08:41:01.861473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:41:01.861473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:41:01.861473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:41:01.861473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:41:01.861473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:41:01.861473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:41:01.861473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:41:01.861473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:41:01.861473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:41:01.862910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:41:01.862910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:41:01.862910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:41:01.862910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:41:01.862910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:41:01.862910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:41:01.862910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:41:01.862910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8c671d7-3413-41f7-a679-3951058e5050 could not be found. Jul 20 08:41:01.862910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:41:01.862910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:41:01.862910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:41:01.862910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:41:01.862910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:41:01.862910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:41:01.862910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:41:01.862910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:41:01.862910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8c671d7-3413-41f7-a679-3951058e5050 could not be found. Jul 20 08:41:01.862910 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: ERROR nova.api.openstack.wsgi Jul 20 08:41:01.864470 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-8aac498c-f628-44ca-bb0e-dbf93608598d tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Returning 404 to user: Instance c8c671d7-3413-41f7-a679-3951058e5050 could not be found. {{(pid=117828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:41:01.864470 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-8aac498c-f628-44ca-bb0e-dbf93608598d tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050" status: 404 len: 111 microversion: 2.1 time: 0.030623 Jul 20 08:41:01.864470 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 723/1394] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:41:01 2022] GET /compute/v2.1/servers/c8c671d7-3413-41f7-a679-3951058e5050 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:41:11.769205 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:41:11.769930 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:41:11.773934 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-efab2ae6-cd5d-4c79-8357-79689da6aa2e tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1683046034", "imageRef": "5d6b971e-8afe-4e4a-b054-20cd61970c65", "flavorRef": "452", "networks": [{"uuid": "81a79de6-5fd5-4905-8d83-7fd26aa203bb"}]}} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:41:11.826385 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.network.neutron [None req-efab2ae6-cd5d-4c79-8357-79689da6aa2e tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] validate_networks() for [('81a79de6-5fd5-4905-8d83-7fd26aa203bb', None, None, None, None, None)] {{(pid=117829) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 08:41:12.187735 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-efab2ae6-cd5d-4c79-8357-79689da6aa2e tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Flavor limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 08:41:12.188148 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-efab2ae6-cd5d-4c79-8357-79689da6aa2e tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Image limits 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 08:41:12.188873 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-efab2ae6-cd5d-4c79-8357-79689da6aa2e tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Flavor pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 08:41:12.189038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-efab2ae6-cd5d-4c79-8357-79689da6aa2e tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Image pref 0:0:0 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 08:41:12.189443 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.virt.hardware [None req-efab2ae6-cd5d-4c79-8357-79689da6aa2e tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 08:41:12.198340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-efab2ae6-cd5d-4c79-8357-79689da6aa2e tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:12.198819 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-efab2ae6-cd5d-4c79-8357-79689da6aa2e tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:12.199982 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-efab2ae6-cd5d-4c79-8357-79689da6aa2e tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:12.200117 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-efab2ae6-cd5d-4c79-8357-79689da6aa2e tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:12.217844 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-efab2ae6-cd5d-4c79-8357-79689da6aa2e tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Getting quotas for project 0be8b8329d994ec59a61a90f29b2b629. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 08:41:12.221841 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.quota [None req-efab2ae6-cd5d-4c79-8357-79689da6aa2e tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Getting quotas for user 75c0c2f20205457cb2bf99ed549b7517 and project 0be8b8329d994ec59a61a90f29b2b629. Resources: {'cores', 'ram', 'instances'} {{(pid=117829) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 08:41:12.233591 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-efab2ae6-cd5d-4c79-8357-79689da6aa2e tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Going to run 1 instances... {{(pid=117829) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 08:41:12.236279 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-efab2ae6-cd5d-4c79-8357-79689da6aa2e tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d6b971e-8afe-4e4a-b054-20cd61970c65',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117829) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 08:41:12.285109 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-efab2ae6-cd5d-4c79-8357-79689da6aa2e tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517223 Jul 20 08:41:12.285677 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 672/1395] 10.222.0.64 () {60 vars in 1146 bytes} [Wed Jul 20 08:41:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 08:41:12.295671 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-70a4d511-68de-46b9-bddc-4a56d722d7a4 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:41:12.296276 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-70a4d511-68de-46b9-bddc-4a56d722d7a4 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:41:12.298928 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=7 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:41:12.299581 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=22,nova_cell1:INSERT=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:41:12.354774 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-70a4d511-68de-46b9-bddc-4a56d722d7a4 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:41:12.362571 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-70a4d511-68de-46b9-bddc-4a56d722d7a4 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802" status: 200 len: 1219 microversion: 2.1 time: 0.070672 Jul 20 08:41:12.363143 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 724/1396] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:41:12 2022] GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:41:13.382723 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f0ebb558-b22d-41f7-a2d4-cf8d4754545b tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:41:13.383837 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f0ebb558-b22d-41f7-a2d4-cf8d4754545b tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:41:13.392216 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f0ebb558-b22d-41f7-a2d4-cf8d4754545b tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:13.392908 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f0ebb558-b22d-41f7-a2d4-cf8d4754545b tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:13.393929 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f0ebb558-b22d-41f7-a2d4-cf8d4754545b tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:13.394508 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f0ebb558-b22d-41f7-a2d4-cf8d4754545b tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:13.474015 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f0ebb558-b22d-41f7-a2d4-cf8d4754545b tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:41:13.482293 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f0ebb558-b22d-41f7-a2d4-cf8d4754545b tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802" status: 200 len: 1277 microversion: 2.1 time: 0.105370 Jul 20 08:41:13.483590 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 673/1397] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:41:13 2022] GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 => generated 1277 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:41:14.500691 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-a767bb05-60aa-4c5a-b263-950453956e81 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:41:14.501555 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-a767bb05-60aa-4c5a-b263-950453956e81 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:41:14.508456 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a767bb05-60aa-4c5a-b263-950453956e81 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:14.508968 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a767bb05-60aa-4c5a-b263-950453956e81 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:14.509800 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a767bb05-60aa-4c5a-b263-950453956e81 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:14.510293 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-a767bb05-60aa-4c5a-b263-950453956e81 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:14.651662 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-a767bb05-60aa-4c5a-b263-950453956e81 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:41:14.659436 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-a767bb05-60aa-4c5a-b263-950453956e81 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802" status: 200 len: 1319 microversion: 2.1 time: 0.163115 Jul 20 08:41:14.660020 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 725/1398] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:41:14 2022] GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:41:14.853210 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [req-847c4219-e7b2-4193-9a2b-d3b92265d570 req-d1364909-18ee-40fc-ab02-ae99b493c4a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802", "tag": "88040eab-26ec-41bd-a4e9-cf05a5857d44"}]} {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:41:14.862806 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-847c4219-e7b2-4193-9a2b-d3b92265d570 req-d1364909-18ee-40fc-ab02-ae99b493c4a1 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:14.863406 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [req-847c4219-e7b2-4193-9a2b-d3b92265d570 req-d1364909-18ee-40fc-ab02-ae99b493c4a1 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:14.875228 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.compute.server_external_events [req-847c4219-e7b2-4193-9a2b-d3b92265d570 req-d1364909-18ee-40fc-ab02-ae99b493c4a1 service nova] Creating event network-changed:88040eab-26ec-41bd-a4e9-cf05a5857d44 for instance ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 on hv-cinder-82308 Jul 20 08:41:14.880119 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [req-847c4219-e7b2-4193-9a2b-d3b92265d570 req-d1364909-18ee-40fc-ab02-ae99b493c4a1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030765 Jul 20 08:41:14.880923 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 674/1399] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:41:15.676870 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-50389d5f-60ca-4f01-a252-17e43bec5cc8 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:41:15.677539 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-50389d5f-60ca-4f01-a252-17e43bec5cc8 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:41:15.684855 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-50389d5f-60ca-4f01-a252-17e43bec5cc8 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:15.685443 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-50389d5f-60ca-4f01-a252-17e43bec5cc8 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:15.687059 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-50389d5f-60ca-4f01-a252-17e43bec5cc8 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:15.687526 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-50389d5f-60ca-4f01-a252-17e43bec5cc8 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:15.825170 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-50389d5f-60ca-4f01-a252-17e43bec5cc8 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:41:15.832986 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-50389d5f-60ca-4f01-a252-17e43bec5cc8 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802" status: 200 len: 1319 microversion: 2.1 time: 0.159916 Jul 20 08:41:15.833638 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 726/1400] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:41:15 2022] GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:41:16.850381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-f85bd798-5d17-46af-9b66-afe32169cbc7 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:41:16.851120 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-f85bd798-5d17-46af-9b66-afe32169cbc7 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:41:16.857316 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f85bd798-5d17-46af-9b66-afe32169cbc7 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:16.857797 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f85bd798-5d17-46af-9b66-afe32169cbc7 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:16.858572 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f85bd798-5d17-46af-9b66-afe32169cbc7 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:16.859028 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-f85bd798-5d17-46af-9b66-afe32169cbc7 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:16.990672 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-f85bd798-5d17-46af-9b66-afe32169cbc7 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:41:16.998022 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-f85bd798-5d17-46af-9b66-afe32169cbc7 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802" status: 200 len: 1319 microversion: 2.1 time: 0.152373 Jul 20 08:41:16.999254 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 675/1401] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:41:16 2022] GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:41:18.015139 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-20e21b82-1fb8-45e8-86fe-b7197c6263e1 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:41:18.015738 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-20e21b82-1fb8-45e8-86fe-b7197c6263e1 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:41:18.022812 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-20e21b82-1fb8-45e8-86fe-b7197c6263e1 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:18.023262 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-20e21b82-1fb8-45e8-86fe-b7197c6263e1 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:18.024430 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-20e21b82-1fb8-45e8-86fe-b7197c6263e1 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:18.024430 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-20e21b82-1fb8-45e8-86fe-b7197c6263e1 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:18.163081 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-20e21b82-1fb8-45e8-86fe-b7197c6263e1 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:41:18.171334 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-20e21b82-1fb8-45e8-86fe-b7197c6263e1 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802" status: 200 len: 1319 microversion: 2.1 time: 0.159658 Jul 20 08:41:18.172115 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 727/1402] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:41:18 2022] GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:41:19.188930 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-95fd48fd-176e-44c3-9171-5ce470f055ae tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:41:19.189567 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-95fd48fd-176e-44c3-9171-5ce470f055ae tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:41:19.196199 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-95fd48fd-176e-44c3-9171-5ce470f055ae tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:19.196644 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-95fd48fd-176e-44c3-9171-5ce470f055ae tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:19.197418 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-95fd48fd-176e-44c3-9171-5ce470f055ae tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:19.200179 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-95fd48fd-176e-44c3-9171-5ce470f055ae tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:19.332239 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-95fd48fd-176e-44c3-9171-5ce470f055ae tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:41:19.340531 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-95fd48fd-176e-44c3-9171-5ce470f055ae tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802" status: 200 len: 1319 microversion: 2.1 time: 0.155983 Jul 20 08:41:19.341095 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 676/1403] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:41:19 2022] GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:41:19.905721 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-0bbd9f40-3eeb-4d10-9400-2614f871a2ad req-75e6a1d7-a699-4181-9d29-cf37eadf7675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802", "name": "network-vif-plugged", "status": "completed", "tag": "88040eab-26ec-41bd-a4e9-cf05a5857d44"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:41:19.915575 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-0bbd9f40-3eeb-4d10-9400-2614f871a2ad req-75e6a1d7-a699-4181-9d29-cf37eadf7675 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:19.916007 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-0bbd9f40-3eeb-4d10-9400-2614f871a2ad req-75e6a1d7-a699-4181-9d29-cf37eadf7675 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:19.928273 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-0bbd9f40-3eeb-4d10-9400-2614f871a2ad req-75e6a1d7-a699-4181-9d29-cf37eadf7675 service nova] Creating event network-vif-plugged:88040eab-26ec-41bd-a4e9-cf05a5857d44 for instance ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 on hv-cinder-82308 Jul 20 08:41:19.933124 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-0bbd9f40-3eeb-4d10-9400-2614f871a2ad req-75e6a1d7-a699-4181-9d29-cf37eadf7675 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032177 Jul 20 08:41:19.933926 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 728/1404] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:41:20.357254 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-fe978eb3-cc85-459f-a6ab-9d617e9d4842 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:41:20.357849 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-fe978eb3-cc85-459f-a6ab-9d617e9d4842 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:41:20.364417 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fe978eb3-cc85-459f-a6ab-9d617e9d4842 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:20.364861 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fe978eb3-cc85-459f-a6ab-9d617e9d4842 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:20.365622 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fe978eb3-cc85-459f-a6ab-9d617e9d4842 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:20.366055 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-fe978eb3-cc85-459f-a6ab-9d617e9d4842 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:20.495104 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-fe978eb3-cc85-459f-a6ab-9d617e9d4842 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:41:20.503030 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-fe978eb3-cc85-459f-a6ab-9d617e9d4842 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802" status: 200 len: 1319 microversion: 2.1 time: 0.149604 Jul 20 08:41:20.503596 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 677/1405] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:41:20 2022] GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:41:21.521770 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-f48738a3-7e31-4afe-bdd7-01013fb7e63d tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:41:21.522461 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-f48738a3-7e31-4afe-bdd7-01013fb7e63d tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:41:21.528737 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f48738a3-7e31-4afe-bdd7-01013fb7e63d tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:21.529194 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f48738a3-7e31-4afe-bdd7-01013fb7e63d tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:21.530685 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f48738a3-7e31-4afe-bdd7-01013fb7e63d tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:21.531118 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-f48738a3-7e31-4afe-bdd7-01013fb7e63d tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:21.667678 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-f48738a3-7e31-4afe-bdd7-01013fb7e63d tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:41:21.676213 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-f48738a3-7e31-4afe-bdd7-01013fb7e63d tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802" status: 200 len: 1319 microversion: 2.1 time: 0.159244 Jul 20 08:41:21.676783 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 729/1406] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:41:21 2022] GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:41:22.693467 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-515d021b-3dfb-4347-835b-975c2b775442 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:41:22.694004 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-515d021b-3dfb-4347-835b-975c2b775442 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:41:22.695998 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=2 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:41:22.696659 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell0:SELECT=6 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:41:22.702978 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-515d021b-3dfb-4347-835b-975c2b775442 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:22.703426 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-515d021b-3dfb-4347-835b-975c2b775442 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:22.704193 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-515d021b-3dfb-4347-835b-975c2b775442 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:22.704628 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-515d021b-3dfb-4347-835b-975c2b775442 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:22.838296 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-515d021b-3dfb-4347-835b-975c2b775442 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:41:22.847759 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-515d021b-3dfb-4347-835b-975c2b775442 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802" status: 200 len: 1507 microversion: 2.1 time: 0.158380 Jul 20 08:41:22.848340 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 678/1407] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:41:22 2022] GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:41:22.865387 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-5b8fb94f-d08d-4947-a60e-bd5f669d9e7c tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebeb13a2-bc57-410d-ac0b-92c920b46654", "device": "/dev/sdb"}} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:41:22.866484 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-5b8fb94f-d08d-4947-a60e-bd5f669d9e7c tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:41:22.868671 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell0:SELECT=2 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:41:22.874482 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5b8fb94f-d08d-4947-a60e-bd5f669d9e7c tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:22.874956 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5b8fb94f-d08d-4947-a60e-bd5f669d9e7c tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:22.875726 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5b8fb94f-d08d-4947-a60e-bd5f669d9e7c tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:22.876160 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-5b8fb94f-d08d-4947-a60e-bd5f669d9e7c tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:23.125688 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-5b8fb94f-d08d-4947-a60e-bd5f669d9e7c tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "POST /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264107 Jul 20 08:41:23.126424 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 730/1408] 10.222.0.64 () {60 vars in 1322 bytes} [Wed Jul 20 08:41:22 2022] POST /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 08:41:44.477124 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-e26862a6-34e6-49d6-a1d2-2de1ec64ae51 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:41:44.477706 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-e26862a6-34e6-49d6-a1d2-2de1ec64ae51 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:41:44.480238 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:41:44.481075 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG dbcounter [-] [117829] Writing DB stats nova_cell1:SELECT=34 {{(pid=117829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:41:44.489508 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e26862a6-34e6-49d6-a1d2-2de1ec64ae51 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:44.489960 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e26862a6-34e6-49d6-a1d2-2de1ec64ae51 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:44.490776 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e26862a6-34e6-49d6-a1d2-2de1ec64ae51 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:44.491213 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-e26862a6-34e6-49d6-a1d2-2de1ec64ae51 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:44.577301 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.objects.instance [None req-e26862a6-34e6-49d6-a1d2-2de1ec64ae51 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lazy-loading 'services' on Instance uuid ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 {{(pid=117829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 08:41:44.649105 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-e26862a6-34e6-49d6-a1d2-2de1ec64ae51 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802/os-volume_attachments/ebeb13a2-bc57-410d-ac0b-92c920b46654" status: 202 len: 0 microversion: 2.1 time: 0.176703 Jul 20 08:41:44.649779 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 679/1409] 10.222.0.64 () {58 vars in 1415 bytes} [Wed Jul 20 08:41:44 2022] DELETE /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802/os-volume_attachments/ebeb13a2-bc57-410d-ac0b-92c920b46654 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 08:41:46.811082 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_api:SELECT=16 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:41:46.812443 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG dbcounter [-] [117828] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 08:41:46.816488 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-0723e655-35a9-42c2-9c2f-aa05588b84bc tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:41:46.817068 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0723e655-35a9-42c2-9c2f-aa05588b84bc tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:41:46.824458 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0723e655-35a9-42c2-9c2f-aa05588b84bc tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:46.824819 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0723e655-35a9-42c2-9c2f-aa05588b84bc tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:46.825592 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0723e655-35a9-42c2-9c2f-aa05588b84bc tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:46.826024 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-0723e655-35a9-42c2-9c2f-aa05588b84bc tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:46.852460 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-0723e655-35a9-42c2-9c2f-aa05588b84bc tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802] Going to try to terminate instance {{(pid=117828) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 08:41:46.933105 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-0723e655-35a9-42c2-9c2f-aa05588b84bc tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802" status: 204 len: 0 microversion: 2.1 time: 0.123264 Jul 20 08:41:46.933693 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 731/1410] 10.222.0.64 () {58 vars in 1238 bytes} [Wed Jul 20 08:41:46 2022] DELETE /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 08:41:46.943593 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-1ef24174-6454-4f9e-b62d-9b0c085b0989 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:41:46.944310 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-1ef24174-6454-4f9e-b62d-9b0c085b0989 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:41:46.950560 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1ef24174-6454-4f9e-b62d-9b0c085b0989 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:46.951038 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1ef24174-6454-4f9e-b62d-9b0c085b0989 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:46.951781 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1ef24174-6454-4f9e-b62d-9b0c085b0989 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:46.952234 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-1ef24174-6454-4f9e-b62d-9b0c085b0989 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:47.083639 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-1ef24174-6454-4f9e-b62d-9b0c085b0989 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:41:47.091057 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-1ef24174-6454-4f9e-b62d-9b0c085b0989 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802" status: 200 len: 1513 microversion: 2.1 time: 0.152076 Jul 20 08:41:47.091827 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 680/1411] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:41:46 2022] GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:41:48.110573 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [None req-265b1838-0f6f-426c-9cae-d6ea177b9439 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:41:48.111288 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.compute.api [None req-265b1838-0f6f-426c-9cae-d6ea177b9439 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802] Fetching instance by UUID {{(pid=117828) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:41:48.117793 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-265b1838-0f6f-426c-9cae-d6ea177b9439 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:48.118238 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-265b1838-0f6f-426c-9cae-d6ea177b9439 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:48.119033 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-265b1838-0f6f-426c-9cae-d6ea177b9439 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:48.119473 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [None req-265b1838-0f6f-426c-9cae-d6ea177b9439 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:48.256070 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.policy [None req-265b1838-0f6f-426c-9cae-d6ea177b9439 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117828) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:41:48.263975 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [None req-265b1838-0f6f-426c-9cae-d6ea177b9439 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802" status: 200 len: 1513 microversion: 2.1 time: 0.158406 Jul 20 08:41:48.264542 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 732/1412] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:41:48 2022] GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 08:41:49.281755 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-8782baf4-05f1-4dce-817d-2d7ccbf479cc tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:41:49.282490 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-8782baf4-05f1-4dce-817d-2d7ccbf479cc tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:41:49.288936 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8782baf4-05f1-4dce-817d-2d7ccbf479cc tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:49.289381 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8782baf4-05f1-4dce-817d-2d7ccbf479cc tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:49.290154 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8782baf4-05f1-4dce-817d-2d7ccbf479cc tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:49.290599 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-8782baf4-05f1-4dce-817d-2d7ccbf479cc tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:49.358917 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.policy [None req-8782baf4-05f1-4dce-817d-2d7ccbf479cc tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c0c2f20205457cb2bf99ed549b7517', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be8b8329d994ec59a61a90f29b2b629', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117829) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 08:41:49.367544 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-8782baf4-05f1-4dce-817d-2d7ccbf479cc tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802" status: 200 len: 1471 microversion: 2.1 time: 0.090326 Jul 20 08:41:49.368133 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 681/1413] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:41:49 2022] GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 => generated 1471 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 08:41:49.447052 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG nova.api.openstack.wsgi [req-72ea7057-844e-468d-8801-0f8510b7f966 req-5a2fe3db-7e38-4871-8b4a-81c01883c702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802", "name": "network-vif-deleted", "tag": "88040eab-26ec-41bd-a4e9-cf05a5857d44"}]} {{(pid=117828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 08:41:49.455640 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-72ea7057-844e-468d-8801-0f8510b7f966 req-5a2fe3db-7e38-4871-8b4a-81c01883c702 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:49.456037 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: DEBUG oslo_concurrency.lockutils [req-72ea7057-844e-468d-8801-0f8510b7f966 req-5a2fe3db-7e38-4871-8b4a-81c01883c702 service nova] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:49.467267 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.compute.server_external_events [req-72ea7057-844e-468d-8801-0f8510b7f966 req-5a2fe3db-7e38-4871-8b4a-81c01883c702 service nova] Creating event network-vif-deleted:88040eab-26ec-41bd-a4e9-cf05a5857d44 for instance ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 on hv-cinder-82308 Jul 20 08:41:49.472834 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO nova.api.openstack.requestlog [req-72ea7057-844e-468d-8801-0f8510b7f966 req-5a2fe3db-7e38-4871-8b4a-81c01883c702 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165344 Jul 20 08:41:49.473419 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: [pid: 117828|app: 0|req: 733/1414] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Jul 20 08:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 08:41:50.385004 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9ed48077-edb5-4014-aed7-3a0ebde846e5 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Calling method '>' {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 08:41:50.385614 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.compute.api [None req-9ed48077-edb5-4014-aed7-3a0ebde846e5 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] [instance: ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802] Fetching instance by UUID {{(pid=117829) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 08:41:50.393065 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9ed48077-edb5-4014-aed7-3a0ebde846e5 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:50.393512 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9ed48077-edb5-4014-aed7-3a0ebde846e5 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:50.394289 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9ed48077-edb5-4014-aed7-3a0ebde846e5 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 08:41:50.394802 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG oslo_concurrency.lockutils [None req-9ed48077-edb5-4014-aed7-3a0ebde846e5 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Lock "a041b14b-60ad-4ca6-8308-c42feb8d914c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 08:41:50.407993 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.wsgi [None req-9ed48077-edb5-4014-aed7-3a0ebde846e5 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] HTTP exception thrown: Instance ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 could not be found. Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9ed48077-edb5-4014-aed7-3a0ebde846e5 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Request method failure captured: Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: request: GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 HTTP/1.1 Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept: application/json Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Accept-Encoding: identity Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Connection: close Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Length: 0 Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Content-Type: application/json Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Host: 10.222.0.64 Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Openstack-System-Scope: None Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: User-Agent: python-urllib3/1.26.9 Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Auth-Token: gAAAAABi179BhOjmy7lnU_yb5C_UxIMq5j4u2xVPXF1bgLfOFjnjj37ILrBaFOBu8UC7FbjGkWO3Jux4gDfIXwujpmUh85AOeoBANAHxbr8MyzD8CR76l0ZP4cbtKwMQ4dOLOhOS5gbwWIXyg8rAZ-i355JoGvABmk1Ahqp8eJfEJGqcJtUcJHU Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Id: None Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Domain-Name: None Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Identity-Status: Confirmed Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Is-Admin-Project: True Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Id: default Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Domain-Name: Default Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Id: 0be8b8329d994ec59a61a90f29b2b629 Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1824569512 Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Role: reader,member Jul 20 08:41:50.409610 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Roles: reader,member Jul 20 08:41:50.411286 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0be8b8329d994ec59a61a90f29b2b629"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/0be8b8329d994ec59a61a90f29b2b629"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_0be8b8329d994ec59a61a90f29b2b629", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/0be8b8329d994ec59a61a90f29b2b629"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}] Jul 20 08:41:50.411286 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant: tempest-VolumesSnapshotTestJSON-1824569512 Jul 20 08:41:50.411286 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Id: 0be8b8329d994ec59a61a90f29b2b629 Jul 20 08:41:50.411286 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1824569512 Jul 20 08:41:50.411286 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User: tempest-VolumesSnapshotTestJSON-1824569512-project Jul 20 08:41:50.411286 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Id: default Jul 20 08:41:50.411286 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Domain-Name: Default Jul 20 08:41:50.411286 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Id: 75c0c2f20205457cb2bf99ed549b7517 Jul 20 08:41:50.411286 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: X-User-Name: tempest-VolumesSnapshotTestJSON-1824569512-project Jul 20 08:41:50.411286 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: method: > Jul 20 08:41:50.411286 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: exception: Instance ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 could not be found. Jul 20 08:41:50.411286 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: action_args: {'id': 'ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802'} Jul 20 08:41:50.412164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: {{(pid=117829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 08:41:50.412164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:41:50.412164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 08:41:50.412164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 08:41:50.412164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 08:41:50.412164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 08:41:50.412164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 08:41:50.412164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 08:41:50.412164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 08:41:50.412164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 08:41:50.412164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 could not be found. Jul 20 08:41:50.412164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:41:50.412164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:41:50.412164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:41:50.412164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:41:50.412164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:41:50.412164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:41:50.412164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 08:41:50.412164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 08:41:50.412164 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 08:41:50.413876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 08:41:50.413876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 08:41:50.413876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 08:41:50.413876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 08:41:50.413876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 08:41:50.413876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 08:41:50.413876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 08:41:50.413876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 could not be found. Jul 20 08:41:50.413876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:41:50.413876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 08:41:50.413876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:41:50.413876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 08:41:50.413876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 08:41:50.413876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 08:41:50.413876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 08:41:50.413876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 08:41:50.413876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 could not be found. Jul 20 08:41:50.413876 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: ERROR nova.api.openstack.wsgi Jul 20 08:41:50.415335 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: DEBUG nova.api.openstack.wsgi [None req-9ed48077-edb5-4014-aed7-3a0ebde846e5 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] Returning 404 to user: Instance ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 could not be found. {{(pid=117829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 08:41:50.415335 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO nova.api.openstack.requestlog [None req-9ed48077-edb5-4014-aed7-3a0ebde846e5 tempest-VolumesSnapshotTestJSON-1824569512 tempest-VolumesSnapshotTestJSON-1824569512-project] 10.222.0.64 "GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802" status: 404 len: 111 microversion: 2.1 time: 0.029872 Jul 20 08:41:50.415335 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: [pid: 117829|app: 0|req: 682/1415] 10.222.0.64 () {58 vars in 1235 bytes} [Wed Jul 20 08:41:50 2022] GET /compute/v2.1/servers/ec1a18bd-3d68-4b8b-a2e3-e1f8f0b07802 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 08:42:44.855121 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 08:42:44.855736 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Wed Jul 20 08:42:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 08:44:09.895595 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 08:44:09.896311 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Wed Jul 20 08:44:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 08:44:12.197670 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 08:44:12.198354 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Wed Jul 20 08:44:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 08:44:29.947918 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 08:44:29.948562 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Wed Jul 20 08:44:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 08:44:35.311270 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 08:44:35.311839 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Wed Jul 20 08:44:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 08:46:04.864828 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 08:46:04.865493 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Wed Jul 20 08:46:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 08:46:11.701431 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 08:46:11.701958 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Wed Jul 20 08:46:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 08:47:29.905083 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 08:47:29.906230 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Wed Jul 20 08:47:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 08:47:32.206208 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 08:47:32.206845 dv-cinder-823089-3-iscsi devstack@n-api.service[117829]: Wed Jul 20 08:47:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 08:47:49.956195 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 08:47:49.956843 dv-cinder-823089-3-iscsi devstack@n-api.service[117828]: Wed Jul 20 08:47:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!